-- Logs begin at Mon 2022-08-22 10:15:07 UTC, end at Mon 2022-08-22 11:24:28 UTC. -- Aug 22 10:55:40.011921 dv-cinder-853941-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 10:55:40.021560 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 10:55:40 2022] *** Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: nodename: dv-cinder-853941-1-iscsi Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: machine: x86_64 Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: clock source: unix Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: pcre jit disabled Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: detected number of CPU cores: 4 Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: current working directory: / Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: detected binary path: /usr/bin/uwsgi-core Aug 22 10:55:40.023565 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: your processes number limit is 47680 Aug 22 10:55:40.024344 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: your memory page size is 4096 bytes Aug 22 10:55:40.024344 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: detected max file descriptor number: 2048 Aug 22 10:55:40.024344 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: lock engine: pthread robust mutexes Aug 22 10:55:40.024344 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: thunder lock: enabled Aug 22 10:55:40.024344 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 10:55:40.024344 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 10:55:40.062942 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: Python main interpreter initialized at 0x55e5428259c0 Aug 22 10:55:40.062942 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: python threads support enabled Aug 22 10:55:40.062942 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: your server socket listen backlog is limited to 100 connections Aug 22 10:55:40.062942 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: your mercy for graceful operations on workers is 90 seconds Aug 22 10:55:40.063325 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 10:55:40.063400 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: *** Operational MODE: preforking *** Aug 22 10:55:40.063623 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: *** uWSGI is running in multiple interpreter mode *** Aug 22 10:55:40.063623 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: spawned uWSGI master process (pid: 105977) Aug 22 10:55:40.063838 dv-cinder-853941-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 10:55:40.065914 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: spawned uWSGI worker 1 (pid: 105990, cores: 1) Aug 22 10:55:40.065914 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: spawned uWSGI worker 2 (pid: 105991, cores: 1) Aug 22 10:55:40.068861 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 10:55:41.011924 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 10:55:41.014502 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 10:55:42.123299 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 10:55:42.123299 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: from cryptography.utils import int_from_bytes Aug 22 10:55:42.123978 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 10:55:42.123978 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: from cryptography.utils import int_from_bytes Aug 22 10:55:42.125605 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 10:55:42.125605 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: from cryptography.utils import int_from_bytes Aug 22 10:55:42.126027 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 10:55:42.126027 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: from cryptography.utils import int_from_bytes Aug 22 10:55:44.614377 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 10:55:44.615028 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 10:55:44.615151 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 10:55:44.615510 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 10:55:44.615761 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 10:55:44.616143 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.616465 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.616783 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.616948 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 10:55:44.617318 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.617402 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 10:55:44.617488 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.617704 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.617803 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 10:55:44.618020 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.618106 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 10:55:44.618342 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 10:55:44.618463 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.618671 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.618762 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.618931 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.619052 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.619244 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.619377 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.619563 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-1-iscsi {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.619703 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.619878 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.620034 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.620428 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.620600 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.620746 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.620923 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621067 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621246 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621371 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621572 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621689 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621835 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.621991 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.622153 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.622502 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-1-iscsi {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.622600 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.622829 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.622918 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.623136 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.623221 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.623452 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.623547 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.623772 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.623861 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.624081 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.624180 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.624405 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.624498 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.624711 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.624795 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.625035 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.625216 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.625355 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.625531 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.625663 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.625850 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.626068 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-1-iscsi {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.626158 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.626416 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.626502 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.626728 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.626817 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.627143 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.627262 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.627552 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.627738 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.627859 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.628058 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.628150 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.628474 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.628708 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.628835 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.629063 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.629156 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-1-iscsi {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.629385 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.629471 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.629701 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.629785 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630016 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630102 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630354 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630444 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630655 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630741 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.630959 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631060 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631284 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631381 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631577 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631662 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631876 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.631962 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.632176 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.632285 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.632426 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.632609 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.632728 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.632928 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633045 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633250 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633363 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633551 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633682 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633861 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.633946 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.634167 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.634292 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.634512 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.634606 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.634816 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.634899 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635115 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635207 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635365 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635458 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635674 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635767 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.635993 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636086 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636294 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636378 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636595 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636680 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636863 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.636950 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.637114 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.637199 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.637432 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.637518 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.637751 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.637838 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.638058 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.638144 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.638389 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.638491 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.638700 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.638785 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639008 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639094 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639313 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639411 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639611 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639694 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.639918 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640001 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640222 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640315 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640537 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640621 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640851 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.640941 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.641163 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.641273 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.641467 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.641557 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.641770 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.641861 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.642072 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.642216 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.642411 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.643040 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.643261 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.643480 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.643581 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.643800 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.643917 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.644095 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.644244 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.644397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.644559 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.644711 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.644881 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645019 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645204 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645321 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645515 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645621 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645825 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.645911 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.646136 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.646264 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.646516 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.646609 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.646819 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.646904 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647121 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647215 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647396 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647481 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647699 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647785 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.647998 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.648095 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.648298 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.648390 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.648597 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.648689 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.648907 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649004 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649217 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649301 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649516 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649600 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649815 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.649909 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.650114 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.650257 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.650449 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.650542 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.650763 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.650860 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651064 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651159 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651362 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651498 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651667 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651759 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.651965 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652048 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652264 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652355 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652575 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652668 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652875 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.652961 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.653175 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.653268 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.653477 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.653570 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.653770 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.653854 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.654069 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.654155 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.654406 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.654506 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.654709 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.654794 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655012 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655095 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655311 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655396 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655611 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655697 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655912 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.655996 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.656213 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.656299 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.656512 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.656604 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.656813 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.656898 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.657108 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.657194 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.657416 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.657507 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.657723 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.657822 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.658026 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.658736 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.658939 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.659089 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.659255 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.659402 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.659565 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.659721 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.659875 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.660055 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.660184 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.660388 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.660497 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.660727 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.660815 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.661040 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.661126 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.661371 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.661459 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.661694 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.661781 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.662007 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.662101 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.662343 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.662432 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.662654 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.662748 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.662963 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.663057 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.663271 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.663355 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 10:55:44.663583 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.663669 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.663894 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.663994 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.664209 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.664293 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.664524 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.664609 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.664854 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665016 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665168 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665253 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665481 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665574 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665795 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.665888 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.666103 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.666192 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.666441 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.666538 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.666767 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.666861 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.667083 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.667176 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.667389 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.667479 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.667707 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.667793 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668030 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668116 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668346 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668431 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668666 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668751 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.668980 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669064 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669288 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669373 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669595 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669682 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669903 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.669995 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.670221 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.670327 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.670569 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.670656 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.670878 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.670969 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.671191 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.671347 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.671502 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.671596 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.671810 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.671895 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.672115 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.672209 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.672424 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.672509 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.672729 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.672813 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.673063 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.673154 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.673375 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.673460 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.673697 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.673781 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674020 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674119 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674363 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674464 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674670 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674759 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.674982 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675068 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675289 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675375 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675593 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675679 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675895 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.675982 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.676197 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.676284 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.676504 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.676591 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.676806 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.676893 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.677121 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.677205 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.677438 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.677521 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.677738 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.677824 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678054 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678144 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678383 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678469 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678693 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678779 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.678996 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679300 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679393 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679603 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679687 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679908 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.679992 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.680214 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.680307 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.680516 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.680600 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.680832 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.680918 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.681138 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.681232 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.681437 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.681522 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.681756 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.681842 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.682060 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.682154 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.682385 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.682484 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.682696 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.682781 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683002 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683095 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683311 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683396 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683618 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683711 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.683923 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684016 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684241 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684330 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684549 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684633 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684855 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.684942 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.685181 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.685266 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.685489 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.685593 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.685789 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.685883 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.686101 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.686249 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.686437 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.686541 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.686749 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.686835 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687050 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687135 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687357 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687519 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687659 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687745 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.687960 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688052 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688259 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688358 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688564 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688651 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688863 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.688948 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.689162 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.689248 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.689547 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.689696 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.689876 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.689970 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.690176 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.690308 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.690532 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.690623 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.690840 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.690925 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.691142 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.691229 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.691443 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.691528 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.691742 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.691873 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692077 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692165 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692378 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692463 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692686 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692783 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.692993 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.693086 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.693299 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.693386 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.693606 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.693698 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.693930 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694015 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694280 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694370 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694559 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694661 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694865 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.694951 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.695169 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.695260 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.695478 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.695572 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.695792 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.695877 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.696100 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.696186 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.696414 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.696508 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.696721 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.696806 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697040 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697125 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697346 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697434 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697663 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697754 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.697964 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.698049 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.698294 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.698382 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.698611 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.698706 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.698925 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699018 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699242 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699326 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699553 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699638 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699857 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.699941 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.700167 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.700252 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.700472 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.700557 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.700777 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.700872 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.701082 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.701167 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.701390 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.701474 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.701701 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.701793 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702007 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702097 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702343 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702431 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702653 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702749 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.702971 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703057 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703278 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703595 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703688 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703895 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.703980 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.704204 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.704333 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.704513 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.704607 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.704829 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.704916 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.705740 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.705840 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.706164 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.706263 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.706515 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.706589 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.706823 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.706906 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.707133 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.707228 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.707441 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.707534 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.707744 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.707839 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708045 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708132 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708351 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708444 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708661 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708754 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.708967 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709061 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709272 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709358 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709573 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709667 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709884 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.709970 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.710187 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.710324 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.710514 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.710613 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.710818 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.710903 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.711122 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.711207 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.711431 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.711525 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.711736 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.711821 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712051 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712135 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712364 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712462 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712661 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712745 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.712962 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713047 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713275 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713371 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713578 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713662 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713877 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.713963 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.714178 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.714281 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.714501 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.714586 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.714825 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.714919 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.715140 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.715287 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.715440 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.715525 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.715752 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.715837 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716062 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716155 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716366 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716458 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716674 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716841 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.716980 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717067 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717282 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717366 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717587 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717680 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717891 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.717976 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.718191 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.718305 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.718522 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.718617 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.718826 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.718920 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.719132 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.719263 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.719439 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.719540 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.719755 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.719841 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.720060 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.720145 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.720366 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.720452 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.721235 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.721332 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.721563 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.721700 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.721881 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.722009 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.722193 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.722348 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.722528 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.722841 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.722938 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.723154 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.723250 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.723466 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.723551 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.723788 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.723882 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.724098 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.724186 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.724408 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.724536 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.724718 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.724805 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725023 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725108 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725334 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725419 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725654 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725756 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.725961 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.726217 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.726366 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.726573 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.726714 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.726880 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.726965 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.727181 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.727266 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.727481 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.727566 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.727781 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.727875 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728084 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728170 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728383 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728470 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728682 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728768 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.728980 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729078 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729279 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729365 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729587 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729681 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729887 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.729980 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.730193 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.730299 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.730517 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.730619 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.730836 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.730924 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.731141 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.731233 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.731440 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.731533 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.731738 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.731824 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732038 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732124 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732342 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732649 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732734 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.732966 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733050 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733274 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733361 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733587 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733672 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733895 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.733987 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.734194 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.734299 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.734537 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.734677 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.734842 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.734940 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.735146 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.735232 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.735445 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.735529 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.735753 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.735847 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.736060 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.736145 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.736605 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.737771 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.737771 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738595 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738668 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738668 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738795 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738860 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738860 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738985 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.738985 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739102 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739102 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739217 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739289 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739836 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739923 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.739923 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.740043 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.740107 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.740346 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.740528 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.740650 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.740950 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.741027 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.741256 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.741495 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.741604 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.741856 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.742013 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.742158 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.742492 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.742784 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.742971 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.743174 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.743332 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.743568 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.743672 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.743873 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.743967 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.744193 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.744279 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.744502 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.744813 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.744983 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.745440 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.745659 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.745748 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746011 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746129 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746358 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746459 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746697 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746793 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.746984 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.747086 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.747294 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.747380 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.747751 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.747853 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.747945 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748026 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748272 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748485 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748571 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748786 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.748947 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.749090 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.749389 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.749480 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.749770 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.749862 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.749972 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.750123 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.750291 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.750477 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.755586 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.755746 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.755833 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.755919 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.755999 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756078 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756165 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756240 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756318 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756397 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756474 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756553 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756638 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756726 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756805 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.756889 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757009 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757095 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757183 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757349 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757427 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757505 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757583 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757673 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757753 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757830 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757908 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.757992 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758079 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758169 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758302 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758385 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758476 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758562 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758650 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758730 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758807 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758884 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.758962 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759047 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759142 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759231 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759312 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759390 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759474 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759553 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759640 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759720 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759805 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759891 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.759970 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760055 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760142 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760221 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760307 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760386 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760473 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760562 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760641 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760726 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760726 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760858 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760922 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.760995 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761061 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761131 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761196 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761268 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761333 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761404 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761482 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761560 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761637 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761714 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761854 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.761976 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.762158 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.762317 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.762489 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.762631 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.762790 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.762946 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.763110 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.763251 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.763417 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.763542 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.763717 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.763865 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764021 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764179 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764319 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764492 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764624 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764816 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.764910 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.765139 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.765340 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.765466 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.765651 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.765772 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.765958 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.766086 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.766278 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.766463 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.766590 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.766783 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.766897 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.767097 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.767209 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.767409 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.768102 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.768350 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.768436 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.768706 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.768826 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769033 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769119 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769351 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769436 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769667 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769752 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.769980 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.770067 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.770317 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.770416 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.770627 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.770721 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.770935 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771019 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771233 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771317 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771536 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771675 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771836 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.771929 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.772152 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.772239 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.772452 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.772615 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.772763 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.772849 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.773070 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.773155 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.773457 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.773552 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.773756 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.773842 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.774138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.774285 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.774474 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.774561 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.774777 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.774860 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.775089 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.775173 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.775405 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.775490 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.775719 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.775803 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776016 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776100 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776325 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776433 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776630 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776747 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.776947 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777061 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777265 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777374 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777682 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777880 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.777974 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.778180 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.778327 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.778523 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.778655 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.778841 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.778962 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.779148 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.779267 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.779463 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.779571 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.779868 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.779978 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.780185 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.780280 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.780489 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.780575 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.780807 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.780915 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.781128 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.781223 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.781430 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.781517 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.781729 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.781928 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.782035 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.782273 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.782365 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.782578 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.782664 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.782903 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.783142 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.783319 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.783500 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.783632 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.783838 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.783930 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.784149 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.784236 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.784468 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.784561 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.784782 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.784879 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.785104 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.785227 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.785407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.785500 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.785724 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.785809 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786032 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786117 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786367 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786455 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786693 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786795 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.786994 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.787081 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.787312 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.787397 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.787618 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.787713 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.787917 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788034 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788216 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788360 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788514 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788673 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788850 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.788998 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.789146 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.789327 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.789451 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.789634 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.789775 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.789940 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.790095 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.790271 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.790494 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.790582 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.790824 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.790918 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.791147 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.791234 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.791460 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.791548 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.791776 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.791863 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792084 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792168 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792385 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792471 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792687 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792774 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.792991 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793075 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793290 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793378 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793589 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793676 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793887 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.793983 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.794190 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.794301 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.794509 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.794595 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.794807 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.794913 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.795104 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.795191 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.795423 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.795508 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.795722 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.795816 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796039 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796127 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796342 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796640 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796733 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.796940 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797033 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797238 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797325 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797574 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797662 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797873 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.797958 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.798195 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.798300 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.798526 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.798615 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.799389 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.799502 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.799718 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800012 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800108 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800332 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800418 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800646 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800738 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.800960 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801054 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801266 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801353 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801575 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801659 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801880 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.801965 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.802186 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.802289 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.802515 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.802599 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.802824 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.802910 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.803126 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.803224 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.803431 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.803665 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.803760 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.803992 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.804085 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.804303 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.804396 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.804612 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.804708 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.804921 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805015 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805231 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805325 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805537 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805633 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805838 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.805924 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.806149 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.806282 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.806481 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.806574 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.806787 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.806874 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.807111 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.807196 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.807428 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.807516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.807747 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.807831 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808066 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808162 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808380 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808464 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808690 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808776 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.808998 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.809093 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.809306 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.809400 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.809620 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.809705 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.809934 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810022 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810255 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810343 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810574 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810660 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810885 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.810973 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.811193 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.811430 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.811524 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.811764 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.811859 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812080 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812166 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812384 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812476 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812691 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812860 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.812994 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.813080 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.813301 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.813393 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.813607 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.813706 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.813917 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.814002 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.814247 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.814390 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.814614 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.814759 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.814943 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.815075 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.815267 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.815387 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.815594 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.815702 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.815931 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.816226 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.816312 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.816544 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.816639 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.816858 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.816943 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.817173 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.817260 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.817494 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.817580 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.817811 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.817900 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.818128 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.818222 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.818465 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.818562 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.818782 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.818867 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.819086 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.819184 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.819397 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.819484 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.819703 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.819794 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820004 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820100 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820315 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820408 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820621 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820706 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.820922 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.821017 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.821236 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.821329 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.821538 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.821623 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.821862 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.822064 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.822196 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.822438 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.822535 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.822755 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.822856 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.823076 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.823173 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.823396 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.823482 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.823710 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.823953 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824054 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824275 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824361 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824610 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824695 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824910 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.824995 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.825221 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.825310 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.825526 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.825620 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.825829 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.825916 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.826135 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.826221 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.826468 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.826570 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.826773 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.826860 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.827073 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.827159 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.827379 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.827475 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.827679 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.827803 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828000 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828088 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828303 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828390 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828602 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828688 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828903 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.828988 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.829209 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.829296 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.829510 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.829773 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.829866 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.830649 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.830751 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.830960 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831142 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831262 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831358 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831562 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831672 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831867 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.831963 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.832167 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.832257 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.832473 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.832561 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.832772 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.832916 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833078 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833173 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833377 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833472 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833693 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833779 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.833995 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.834080 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.834335 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.834426 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.834653 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.834749 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.834966 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835053 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835275 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835363 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835584 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835669 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835888 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.835982 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.836217 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.836303 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.836525 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.836618 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.836831 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.837052 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.837140 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.837381 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.837466 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.837698 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.837785 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838022 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838110 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838364 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838452 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838669 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838755 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.838972 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839060 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839274 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839361 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839583 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839680 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839887 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.839980 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.840194 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.840281 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.840498 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.840590 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.840801 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.840887 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.841109 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.841196 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.841414 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.841509 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.841719 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.841805 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842023 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842122 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842353 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842534 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842663 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842750 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.842970 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843056 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843276 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843364 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843582 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843668 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843887 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.843972 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.844197 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.844286 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.844533 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.844781 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.844867 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.845116 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.845212 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.845441 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.845527 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.845861 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846048 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846162 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846270 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846500 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846585 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846810 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.846895 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.847119 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.847208 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.847431 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.847517 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.847747 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.847835 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848059 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848145 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848363 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848452 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848674 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848759 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.848988 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.849076 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.849300 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.849392 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.849614 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.849709 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.849929 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850056 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850277 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850428 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850576 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850676 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850890 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.850977 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.851208 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.851295 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.851517 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.851611 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.851826 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.851912 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.852142 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.852238 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.852475 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.852562 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.852794 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.852869 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.853169 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.853263 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.853394 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.853472 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.853700 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.853776 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854009 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854086 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854347 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854427 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854659 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854747 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.854962 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855048 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855264 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855340 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855572 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855647 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855875 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.855959 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.856177 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.856254 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.856485 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.856620 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.856788 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.856935 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.857095 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.857256 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.857395 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.857997 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858149 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858214 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858312 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858379 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858532 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858611 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858846 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.858929 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.859152 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.859227 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.859451 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.859541 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.859751 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.859837 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860049 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860195 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860349 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860438 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860648 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860734 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.860973 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.861069 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.861997 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.862124 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.862267 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.862443 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.862595 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.862770 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.862916 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.863100 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.863241 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.863417 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.863552 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.863729 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.863872 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864038 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864191 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864355 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864551 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864685 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864800 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.864958 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.865133 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.865254 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.865444 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.865558 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.865755 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.865867 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.866064 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.866176 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.866418 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.866544 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.866708 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.866821 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867023 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867110 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867341 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867436 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867649 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867773 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.867952 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868040 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868256 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868343 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868649 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868868 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.868968 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.869173 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.869260 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.869477 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.869564 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.869798 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.869895 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.870107 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.870476 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.870695 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.870785 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871002 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871099 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871308 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871395 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871617 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871739 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.871928 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872018 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872232 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872328 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872541 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872635 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872854 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.872941 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.873164 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.873257 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.873482 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.873567 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.873800 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.873886 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.874104 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.874198 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.874450 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.874539 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.874772 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.874859 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.875084 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.875169 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.875401 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.875495 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.875733 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.875819 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.876055 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.876141 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.876363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.876457 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.876670 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.876756 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.877050 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.877148 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.877295 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 10:55:44.877583 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.877914 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.878258 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.878592 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.878911 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.879229 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.879544 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.879862 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.880178 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.880500 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.880813 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.881128 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.881454 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.881775 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.882106 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.882460 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.882776 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.883104 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.883434 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.883784 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.884101 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.884452 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.884785 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.885104 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.885420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.885730 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 10:55:44.885978 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105990) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 10:55:45.029871 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO dbcounter [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Registered counter for database nova_api Aug 22 10:55:45.039626 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO dbcounter [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Registered counter for database nova_api Aug 22 10:55:45.051316 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_db.sqlalchemy.engines [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.058269 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writer thread running {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.059148 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_db.sqlalchemy.engines [None req-512059c3-9591-41b8-9753-55368868ac1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.066091 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writer thread running {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.114898 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.context [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4636e7ec-f34c-4137-85d0-63ba3e40bf57(cell1) {{(pid=105991) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 10:55:45.118689 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 10:55:45.119164 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 10:55:45.120990 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 10:55:45.121721 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 10:55:45.122165 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 10:55:45.122308 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.context [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4636e7ec-f34c-4137-85d0-63ba3e40bf57(cell1) {{(pid=105990) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 10:55:45.124302 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 10:55:45.126060 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_concurrency.lockutils [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 10:55:45.126305 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO dbcounter [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Registered counter for database nova_cell0 Aug 22 10:55:45.126574 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_concurrency.lockutils [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 10:55:45.128663 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_concurrency.lockutils [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 10:55:45.129420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_concurrency.lockutils [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 10:55:45.129874 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_concurrency.lockutils [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 10:55:45.131882 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_concurrency.lockutils [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105990) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 10:55:45.132427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO dbcounter [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Registered counter for database nova_cell1 Aug 22 10:55:45.133864 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO dbcounter [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Registered counter for database nova_cell0 Aug 22 10:55:45.139452 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO dbcounter [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Registered counter for database nova_cell1 Aug 22 10:55:45.139724 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_db.sqlalchemy.engines [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.140897 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_db.sqlalchemy.engines [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.147239 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_db.sqlalchemy.engines [None req-512059c3-9591-41b8-9753-55368868ac1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.149031 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_db.sqlalchemy.engines [None req-512059c3-9591-41b8-9753-55368868ac1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.149453 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writer thread running {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.149791 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writer thread running {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.154994 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writer thread running {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.156784 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writer thread running {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.294868 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO dbcounter [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Registered counter for database nova_cell0 Aug 22 10:55:45.303598 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO dbcounter [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Registered counter for database nova_cell0 Aug 22 10:55:45.303782 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_db.sqlalchemy.engines [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.308167 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writer thread running {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.310562 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG oslo_db.sqlalchemy.engines [None req-512059c3-9591-41b8-9753-55368868ac1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105990) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 10:55:45.315403 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writer thread running {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 10:55:45.760416 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: WARNING keystonemiddleware.auth_token [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 10:55:45.767632 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: WARNING keystonemiddleware.auth_token [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 10:55:45.789838 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: WARNING keystonemiddleware.auth_token [None req-512059c3-9591-41b8-9753-55368868ac1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 10:55:45.797030 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: WARNING keystonemiddleware.auth_token [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 10:55:46.108393 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: WARNING keystonemiddleware.auth_token [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 10:55:46.114802 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: WARNING keystonemiddleware.auth_token [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 10:55:46.120012 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5428259c0 pid: 105991 (default app) Aug 22 10:55:46.122330 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:55:46.123507 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 22 10:55:46.123904 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Aug 22 10:55:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:55:46.137274 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: WARNING keystonemiddleware.auth_token [None req-512059c3-9591-41b8-9753-55368868ac1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 10:55:46.143740 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: WARNING keystonemiddleware.auth_token [None req-512059c3-9591-41b8-9753-55368868ac1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 10:55:46.148947 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5428259c0 pid: 105990 (default app) Aug 22 10:57:07.590807 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:07.593099 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002665 Aug 22 10:57:07.593651 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:07.605761 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writing DB stats nova_api:SELECT=3 {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:07.606707 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writing DB stats nova_cell0:SELECT=3 {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:07.608409 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writing DB stats nova_cell1:SELECT=3 {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:07.609779 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:08.496868 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-f61164bf-48cd-4b74-93e3-e2f641da8e59 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:08.531124 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-f61164bf-48cd-4b74-93e3-e2f641da8e59 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930322 Aug 22 10:57:08.531864 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Aug 22 10:57:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:10.907594 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:10.908648 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-74487417-64b8-4f46-b4cb-ec711e80f5c8 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 22 10:57:10.909374 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:11.339000 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-48758d48-9e44-4852-a34b-20a20dad0d85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:11.359174 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 10:57:11.359174 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: warnings.warn(msg) Aug 22 10:57:11.440470 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-48758d48-9e44-4852-a34b-20a20dad0d85 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.524692 Aug 22 10:57:11.441092 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 10:57:11.657524 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-a0f17528-0c0e-4cc8-af84-888b44cd0d40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:11.662143 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 10:57:11.662143 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: warnings.warn(msg) Aug 22 10:57:11.665090 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_api:SELECT=3 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:11.665974 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_cell1:SELECT=3 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:11.666976 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_cell0:SELECT=3 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:11.667696 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:11.808498 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-a0f17528-0c0e-4cc8-af84-888b44cd0d40 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.358955 Aug 22 10:57:11.809093 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Aug 22 10:57:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 10:57:14.169144 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-48758d48-9e44-4852-a34b-20a20dad0d85 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:14.170735 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-48758d48-9e44-4852-a34b-20a20dad0d85 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Aug 22 10:57:14.171560 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:14.847958 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-4fce1956-4ffd-4e22-9f6a-e90afd6b8161 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:14.874512 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 10:57:14.874512 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: warnings.warn(msg) Aug 22 10:57:14.979030 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-4fce1956-4ffd-4e22-9f6a-e90afd6b8161 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.801300 Aug 22 10:57:14.979706 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:14.991984 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-f635f2e0-d9b0-4621-82dd-dce98d7745d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:14.995074 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 10:57:14.995074 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: warnings.warn(msg) Aug 22 10:57:15.085486 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-f635f2e0-d9b0-4621-82dd-dce98d7745d3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097094 Aug 22 10:57:15.086423 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Aug 22 10:57:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 10:57:17.450643 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-4fce1956-4ffd-4e22-9f6a-e90afd6b8161 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:17.453057 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-4fce1956-4ffd-4e22-9f6a-e90afd6b8161 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002861 Aug 22 10:57:17.453467 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:17.848409 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-be6f3cf9-aeb6-4549-97e2-9bea0bda5d57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "ram": 1024, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:17.921317 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-be6f3cf9-aeb6-4549-97e2-9bea0bda5d57 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461796 Aug 22 10:57:17.921897 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:17.934084 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-f869a3c6-d0a1-4dfb-a4f8-9ca0a0ae40dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:18.019142 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-f869a3c6-d0a1-4dfb-a4f8-9ca0a0ae40dd admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088662 Aug 22 10:57:18.019639 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Aug 22 10:57:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:20.403208 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-be6f3cf9-aeb6-4549-97e2-9bea0bda5d57 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:20.404758 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-be6f3cf9-aeb6-4549-97e2-9bea0bda5d57 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Aug 22 10:57:20.405162 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:20.891245 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-21643b7c-54ad-4ee4-a87c-bb5f7112c9ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "id": "d3"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:21.004408 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-21643b7c-54ad-4ee4-a87c-bb5f7112c9ed admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.592895 Aug 22 10:57:21.004870 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:21.017894 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-2c96a5d2-b920-46a1-8952-158b6cb4ab65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:21.107943 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-2c96a5d2-b920-46a1-8952-158b6cb4ab65 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094494 Aug 22 10:57:21.108656 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Aug 22 10:57:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:23.473095 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-21643b7c-54ad-4ee4-a87c-bb5f7112c9ed admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:23.475422 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-21643b7c-54ad-4ee4-a87c-bb5f7112c9ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002790 Aug 22 10:57:23.476396 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:23.934059 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-64547bff-9235-4b1e-9a60-296c89304a67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:24.012291 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-64547bff-9235-4b1e-9a60-296c89304a67 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530170 Aug 22 10:57:24.013285 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:24.025523 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-01a1add7-48ba-4f3b-89a8-8eca65230212 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:24.093939 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-01a1add7-48ba-4f3b-89a8-8eca65230212 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071997 Aug 22 10:57:24.094942 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Mon Aug 22 10:57:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:26.492555 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-64547bff-9235-4b1e-9a60-296c89304a67 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:26.493603 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-64547bff-9235-4b1e-9a60-296c89304a67 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 22 10:57:26.494005 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:26.912284 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-28430c34-25e1-4ebe-bbd5-24d4692b6783 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:26.936722 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-28430c34-25e1-4ebe-bbd5-24d4692b6783 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435792 Aug 22 10:57:26.937323 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Aug 22 10:57:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:57:29.879136 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-64547bff-9235-4b1e-9a60-296c89304a67 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:29.880624 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-64547bff-9235-4b1e-9a60-296c89304a67 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002488 Aug 22 10:57:29.881029 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:30.388829 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-9f334c36-c754-4f15-b1e3-47818db63031 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:30.452449 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-9f334c36-c754-4f15-b1e3-47818db63031 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.564670 Aug 22 10:57:30.452996 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:30.465068 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-f0d3b303-b6b2-4327-82ba-4beed6e98a59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:30.547243 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-f0d3b303-b6b2-4327-82ba-4beed6e98a59 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085755 Aug 22 10:57:30.547739 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Aug 22 10:57:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:32.902671 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-9f334c36-c754-4f15-b1e3-47818db63031 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:32.904144 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-9f334c36-c754-4f15-b1e3-47818db63031 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Aug 22 10:57:32.904738 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:33.290275 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-fbbba5f9-ec8c-4251-9deb-2bb91f932229 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "ram": 2048, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:33.362978 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-fbbba5f9-ec8c-4251-9deb-2bb91f932229 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451525 Aug 22 10:57:33.363558 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:33.376600 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-b9da63f1-4110-4325-9e48-057dadfc6c68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:33.470265 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-b9da63f1-4110-4325-9e48-057dadfc6c68 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097622 Aug 22 10:57:33.470880 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Aug 22 10:57:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:35.854953 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-fbbba5f9-ec8c-4251-9deb-2bb91f932229 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:35.857376 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-fbbba5f9-ec8c-4251-9deb-2bb91f932229 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002672 Aug 22 10:57:35.868214 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:36.288563 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-fa1d3291-e37b-4b16-8669-c8f55c1d33fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "name": "m1.medium", "ram": 4096, "id": "3"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:36.372473 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-fa1d3291-e37b-4b16-8669-c8f55c1d33fa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.507894 Aug 22 10:57:36.374588 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:36.385942 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-300bf646-0de7-438b-803c-4f9a3104d033 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:36.526839 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-300bf646-0de7-438b-803c-4f9a3104d033 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145312 Aug 22 10:57:36.527418 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Aug 22 10:57:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:57:38.926325 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-fa1d3291-e37b-4b16-8669-c8f55c1d33fa admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:38.927914 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-fa1d3291-e37b-4b16-8669-c8f55c1d33fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Aug 22 10:57:38.928473 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:39.364634 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-06380474-9495-46df-bd5d-1ea437e46cb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:39.370571 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:57:39.475367 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-06380474-9495-46df-bd5d-1ea437e46cb7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.540776 Aug 22 10:57:39.476558 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:39.488572 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-5b94bf18-6b19-4251-8ca0-9406c46a3d63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:39.572509 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-5b94bf18-6b19-4251-8ca0-9406c46a3d63 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087590 Aug 22 10:57:39.573096 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Aug 22 10:57:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 10:57:41.978860 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-06380474-9495-46df-bd5d-1ea437e46cb7 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:57:41.979879 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-06380474-9495-46df-bd5d-1ea437e46cb7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 22 10:57:41.980535 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:57:42.419438 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-0ddd1819-57be-465c-9190-080161427370 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:42.483862 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-0ddd1819-57be-465c-9190-080161427370 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497353 Aug 22 10:57:42.484417 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Mon Aug 22 10:57:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:57:42.497546 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-2c6a1075-608e-4c8e-8251-cb812cb3f344 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:57:42.584327 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-2c6a1075-608e-4c8e-8251-cb812cb3f344 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091436 Aug 22 10:57:42.584922 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Mon Aug 22 10:57:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:58:01.520305 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-0ddd1819-57be-465c-9190-080161427370 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:01.521315 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-0ddd1819-57be-465c-9190-080161427370 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 22 10:58:01.521722 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:01.930020 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1e512a95-3f6d-4851-b3e0-cbfe982895ec admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:01.948751 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1e512a95-3f6d-4851-b3e0-cbfe982895ec admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.420060 Aug 22 10:58:01.949281 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Aug 22 10:58:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:03.021936 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-0ddd1819-57be-465c-9190-080161427370 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:03.022966 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-0ddd1819-57be-465c-9190-080161427370 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 22 10:58:03.023366 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:03.543313 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1ba7518c-a5ba-4b58-8663-ebfe54ca8dfe admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:03.549016 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.wsgi [None req-1ba7518c-a5ba-4b58-8663-ebfe54ca8dfe admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1ba7518c-a5ba-4b58-8663-ebfe54ca8dfe admin admin] Request method failure captured: Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Accept: application/json Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Accept-Encoding: gzip, deflate Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Connection: keep-alive Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Content-Length: 0 Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Host: 10.222.0.48 Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Openstack-Api-Version: compute 2.90 Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Openstack-System-Scope: None Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: User-Agent: python-novaclient Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Auth-Token: gAAAAABjA2E68sQSII21uDM-3VL9bpYOMWqfU1g33YW5A0iGNitkOboKa00UKxgVE6z_o7BruT7Ic2_9SXcwGguNFYNnzrvquCC9L5TeQFNsZLNe4Q_v9vrlCm-zfzCHlOk7DpGdFJ1IzWWfinG5uP2BHz7LhbfMu07_4KxZHM20HttT1fLciqM Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Domain-Id: None Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Domain-Name: None Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Identity-Status: Confirmed Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Is-Admin-Project: True Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Domain-Id: default Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Domain-Name: Default Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Name: admin Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Role: member,admin,reader Aug 22 10:58:03.552270 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Roles: member,admin,reader Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce1b87adbe93482a946d0fcf7c513809", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant: admin Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant-Name: admin Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User: admin Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Domain-Id: default Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Domain-Name: Default Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Id: 5f27905b35c14e3c9541d9819a2b2185 Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Name: admin Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: method: > Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: exception: Flavor 42 could not be found. Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: action_args: {'id': '42'} Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 10:58:03.559435 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:03.560420 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.561527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1ba7518c-a5ba-4b58-8663-ebfe54ca8dfe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 10:58:03.562601 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1ba7518c-a5ba-4b58-8663-ebfe54ca8dfe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392424 Aug 22 10:58:03.562601 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 22 10:58:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 10:58:03.563946 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-a64b743b-c842-498b-ab26-be873053d6f3 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:03.568109 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:58:03.587199 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-a64b743b-c842-498b-ab26-be873053d6f3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026834 Aug 22 10:58:03.587762 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 22 10:58:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:03.597732 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-084a57bc-9219-4a1a-af03-95a221d9b81f admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:03.622359 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-084a57bc-9219-4a1a-af03-95a221d9b81f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028176 Aug 22 10:58:03.622899 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 22 10:58:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:03.632259 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-e35713c1-1e8f-431f-9648-6a99fc2854d7 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:03.638353 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.wsgi [None req-e35713c1-1e8f-431f-9648-6a99fc2854d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-e35713c1-1e8f-431f-9648-6a99fc2854d7 admin admin] Request method failure captured: Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Accept: application/json Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Accept-Encoding: gzip, deflate Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Connection: keep-alive Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Content-Length: 0 Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Host: 10.222.0.48 Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Openstack-Api-Version: compute 2.90 Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Openstack-System-Scope: None Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: User-Agent: python-novaclient Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Auth-Token: gAAAAABjA2E68sQSII21uDM-3VL9bpYOMWqfU1g33YW5A0iGNitkOboKa00UKxgVE6z_o7BruT7Ic2_9SXcwGguNFYNnzrvquCC9L5TeQFNsZLNe4Q_v9vrlCm-zfzCHlOk7DpGdFJ1IzWWfinG5uP2BHz7LhbfMu07_4KxZHM20HttT1fLciqM Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Domain-Id: None Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Domain-Name: None Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Identity-Status: Confirmed Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Is-Admin-Project: True Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Domain-Id: default Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Domain-Name: Default Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Name: admin Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Role: member,admin,reader Aug 22 10:58:03.641571 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Roles: member,admin,reader Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce1b87adbe93482a946d0fcf7c513809", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant: admin Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant-Name: admin Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User: admin Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Domain-Id: default Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Domain-Name: Default Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Id: 5f27905b35c14e3c9541d9819a2b2185 Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Name: admin Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: method: > Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: exception: Flavor 42 could not be found. Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: action_args: {'id': '42'} Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 10:58:03.645225 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:03.646033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:03.647091 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-e35713c1-1e8f-431f-9648-6a99fc2854d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 10:58:03.648065 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-e35713c1-1e8f-431f-9648-6a99fc2854d7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014340 Aug 22 10:58:03.648065 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 22 10:58:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 10:58:04.607233 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-084a57bc-9219-4a1a-af03-95a221d9b81f admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:04.608259 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-084a57bc-9219-4a1a-af03-95a221d9b81f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 22 10:58:04.608651 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:05.132342 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-416676b9-1d42-47ac-b626-e434810206fe admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:05.139828 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.wsgi [None req-416676b9-1d42-47ac-b626-e434810206fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-416676b9-1d42-47ac-b626-e434810206fe admin admin] Request method failure captured: Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Accept: application/json Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Accept-Encoding: gzip, deflate Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Connection: keep-alive Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Content-Length: 0 Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Host: 10.222.0.48 Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Openstack-Api-Version: compute 2.90 Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Openstack-System-Scope: None Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: User-Agent: python-novaclient Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Auth-Token: gAAAAABjA2E8QiHL2tJ5i7efSv7Nxcuu1QPWrKdwn52Xora_EynmCDBCaJwg_fTtDe5oH7TtS4d1PkI04jKk4_WDJHNIxFP40shoT9P6gJzDSGojz5Q1lovM2nnAp4KJd7QvtfeMgQEJhrpFI43LNMcKXpsSwQI7HLV51mGBAK1kWUShGGQWzOU Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Domain-Id: None Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Domain-Name: None Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Identity-Status: Confirmed Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Is-Admin-Project: True Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Domain-Id: default Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Domain-Name: Default Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Name: admin Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Role: member,admin,reader Aug 22 10:58:05.141407 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Roles: member,admin,reader Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce1b87adbe93482a946d0fcf7c513809", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant: admin Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant-Name: admin Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User: admin Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Domain-Id: default Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Domain-Name: Default Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Id: 5f27905b35c14e3c9541d9819a2b2185 Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Name: admin Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: method: > Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: exception: Flavor 84 could not be found. Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: action_args: {'id': '84'} Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 10:58:05.143085 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:05.144427 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.146712 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-416676b9-1d42-47ac-b626-e434810206fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 10:58:05.148051 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-416676b9-1d42-47ac-b626-e434810206fe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394016 Aug 22 10:58:05.148051 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 22 10:58:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 10:58:05.152700 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-51d06563-60d2-4034-8af9-5ce36156d22e admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:05.167972 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-51d06563-60d2-4034-8af9-5ce36156d22e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018897 Aug 22 10:58:05.168516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 22 10:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:05.178045 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-e68e7e3e-6e04-4872-9336-34374457a77b admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:05.193465 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-e68e7e3e-6e04-4872-9336-34374457a77b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018987 Aug 22 10:58:05.193986 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 22 10:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:05.203148 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-d2ac39b0-70b5-4fde-a42b-a5da301f80a3 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:05.208456 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.wsgi [None req-d2ac39b0-70b5-4fde-a42b-a5da301f80a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-d2ac39b0-70b5-4fde-a42b-a5da301f80a3 admin admin] Request method failure captured: Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Accept: application/json Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Accept-Encoding: gzip, deflate Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Connection: keep-alive Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Content-Length: 0 Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Host: 10.222.0.48 Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Openstack-Api-Version: compute 2.90 Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Openstack-System-Scope: None Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: User-Agent: python-novaclient Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Auth-Token: gAAAAABjA2E8QiHL2tJ5i7efSv7Nxcuu1QPWrKdwn52Xora_EynmCDBCaJwg_fTtDe5oH7TtS4d1PkI04jKk4_WDJHNIxFP40shoT9P6gJzDSGojz5Q1lovM2nnAp4KJd7QvtfeMgQEJhrpFI43LNMcKXpsSwQI7HLV51mGBAK1kWUShGGQWzOU Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Domain-Id: None Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Domain-Name: None Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Identity-Status: Confirmed Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Is-Admin-Project: True Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Domain-Id: default Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Domain-Name: Default Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Name: admin Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Role: member,admin,reader Aug 22 10:58:05.210002 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Roles: member,admin,reader Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce1b87adbe93482a946d0fcf7c513809", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant: admin Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant-Name: admin Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User: admin Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Domain-Id: default Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Domain-Name: Default Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Id: 5f27905b35c14e3c9541d9819a2b2185 Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Name: admin Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: method: > Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: exception: Flavor 84 could not be found. Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: action_args: {'id': '84'} Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 10:58:05.211516 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:05.212447 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:05.214320 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-d2ac39b0-70b5-4fde-a42b-a5da301f80a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 10:58:05.215672 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-d2ac39b0-70b5-4fde-a42b-a5da301f80a3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011718 Aug 22 10:58:05.215672 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 22 10:58:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 10:58:06.176215 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-e68e7e3e-6e04-4872-9336-34374457a77b admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:06.177217 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-e68e7e3e-6e04-4872-9336-34374457a77b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 22 10:58:06.177607 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:06.698325 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-f3c0c5de-fe2d-4e72-95e2-79782899efd7 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:06.704146 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.wsgi [None req-f3c0c5de-fe2d-4e72-95e2-79782899efd7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-f3c0c5de-fe2d-4e72-95e2-79782899efd7 admin admin] Request method failure captured: Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Accept: application/json Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Accept-Encoding: gzip, deflate Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Connection: keep-alive Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Content-Length: 0 Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Host: 10.222.0.48 Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Openstack-Api-Version: compute 2.90 Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Openstack-System-Scope: None Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: User-Agent: python-novaclient Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Auth-Token: gAAAAABjA2E-DUJ7cygwGWlQao5lGghd3EqJX4cLzT2vZMT1rwVlfEsU-RPZzAkJjHn79Csa_aIJ0GlTkot_muj221Hzw583DdLyIBjpV7nvQ3Isnn7PZQY2GCoLl8oiH9OlBFYCCWxEJxdFxM1jIDoY6fX7ETCnZzYksOyPaPyV0QY2Ar80V-s Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Domain-Id: None Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Domain-Name: None Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Identity-Status: Confirmed Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Is-Admin-Project: True Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Domain-Id: default Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Domain-Name: Default Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Project-Name: admin Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Role: member,admin,reader Aug 22 10:58:06.705636 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Roles: member,admin,reader Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce1b87adbe93482a946d0fcf7c513809", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant: admin Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-Tenant-Name: admin Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User: admin Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Domain-Id: default Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Domain-Name: Default Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Id: 5f27905b35c14e3c9541d9819a2b2185 Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: X-User-Name: admin Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: method: > Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: exception: Flavor 451 could not be found. Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: action_args: {'id': '451'} Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 10:58:06.707138 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:06.708118 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.709363 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-f3c0c5de-fe2d-4e72-95e2-79782899efd7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105990) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 10:58:06.710619 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-f3c0c5de-fe2d-4e72-95e2-79782899efd7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391405 Aug 22 10:58:06.710619 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 22 10:58:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 10:58:06.718735 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-71eaaff0-f759-4fbd-806c-f5177ab6b0e1 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:06.734037 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-71eaaff0-f759-4fbd-806c-f5177ab6b0e1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018845 Aug 22 10:58:06.734656 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 22 10:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:06.743735 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:06.758832 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018543 Aug 22 10:58:06.759378 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 22 10:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:58:06.768342 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-18989edf-9e5a-4e0c-8f26-ca8279432b62 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:06.773523 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.wsgi [None req-18989edf-9e5a-4e0c-8f26-ca8279432b62 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-18989edf-9e5a-4e0c-8f26-ca8279432b62 admin admin] Request method failure captured: Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Accept: application/json Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Accept-Encoding: gzip, deflate Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Connection: keep-alive Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Content-Length: 0 Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Host: 10.222.0.48 Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Openstack-Api-Version: compute 2.90 Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Openstack-System-Scope: None Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: User-Agent: python-novaclient Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Auth-Token: gAAAAABjA2E-DUJ7cygwGWlQao5lGghd3EqJX4cLzT2vZMT1rwVlfEsU-RPZzAkJjHn79Csa_aIJ0GlTkot_muj221Hzw583DdLyIBjpV7nvQ3Isnn7PZQY2GCoLl8oiH9OlBFYCCWxEJxdFxM1jIDoY6fX7ETCnZzYksOyPaPyV0QY2Ar80V-s Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Domain-Id: None Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Domain-Name: None Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Identity-Status: Confirmed Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Is-Admin-Project: True Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Domain-Id: default Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Domain-Name: Default Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Project-Name: admin Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Role: member,admin,reader Aug 22 10:58:06.775033 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Roles: member,admin,reader Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce1b87adbe93482a946d0fcf7c513809", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce1b87adbe93482a946d0fcf7c513809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant: admin Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant-Id: ce1b87adbe93482a946d0fcf7c513809 Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-Tenant-Name: admin Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User: admin Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Domain-Id: default Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Domain-Name: Default Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Id: 5f27905b35c14e3c9541d9819a2b2185 Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: X-User-Name: admin Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: method: > Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: exception: Flavor 451 could not be found. Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: action_args: {'id': '451'} Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 10:58:06.777185 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:06.778080 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: ERROR nova.api.openstack.wsgi Aug 22 10:58:06.779397 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-18989edf-9e5a-4e0c-8f26-ca8279432b62 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 10:58:06.780684 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-18989edf-9e5a-4e0c-8f26-ca8279432b62 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011548 Aug 22 10:58:06.780684 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 22 10:58:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 10:58:07.748055 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:07.749060 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 22 10:58:07.749477 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:08.269554 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-5aa4d7a6-46d7-400b-b6f5-c8e93777b887 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:58:08.338103 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-5aa4d7a6-46d7-400b-b6f5-c8e93777b887 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.448256 Aug 22 10:58:08.339237 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 22 10:58:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:58:09.309527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:09.310555 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 22 10:58:09.310955 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:09.830106 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-a24930f2-3a4d-42ba-ac01-36c1772812b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:58:09.913304 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-a24930f2-3a4d-42ba-ac01-36c1772812b1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.459594 Aug 22 10:58:09.913868 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 22 10:58:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:58:10.889857 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:10.890910 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Aug 22 10:58:10.891313 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:11.428678 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-1f547f18-99c5-45f9-bbf8-5c9e528e7fe8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:58:11.501319 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-1f547f18-99c5-45f9-bbf8-5c9e528e7fe8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.469987 Aug 22 10:58:11.501917 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 22 10:58:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 10:58:12.496402 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:12.497399 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 22 10:58:12.497793 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:13.015171 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-a50bd2d0-99ad-4d45-bddb-f6f96bdee1b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 10:58:13.110062 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-a50bd2d0-99ad-4d45-bddb-f6f96bdee1b3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.475559 Aug 22 10:58:13.110700 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 22 10:58:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 10:58:14.078673 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:14.079727 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 22 10:58:14.080117 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 10:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:58:14.598545 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-75cf1109-83fa-497a-8721-59d47739b910 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:58:14.620134 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-75cf1109-83fa-497a-8721-59d47739b910 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403422 Aug 22 10:58:14.620611 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Aug 22 10:58:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:59:09.129527 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:59:09.130484 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-80f25844-2583-4233-8c9b-000504765fa2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 22 10:59:09.130916 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Mon Aug 22 10:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 10:59:09.141651 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:59:09.520720 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-b3271048-ad8e-4e84-80fb-a1925eba31ab admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:59:09.541213 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-b3271048-ad8e-4e84-80fb-a1925eba31ab admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404084 Aug 22 10:59:09.541747 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Aug 22 10:59:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 10:59:09.562121 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG dbcounter [-] [105990] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105990) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 10:59:09.565779 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-86c3d1f6-869c-4758-be2e-d674a464f816 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:59:09.573776 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-86c3d1f6-869c-4758-be2e-d674a464f816 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013047 Aug 22 10:59:09.575292 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Mon Aug 22 10:59:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:59:09.585586 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-dedbb928-5022-417f-88dc-8a234e5111ab admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:59:09.594002 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-dedbb928-5022-417f-88dc-8a234e5111ab admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011958 Aug 22 10:59:09.594564 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Mon Aug 22 10:59:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:59:09.605840 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:59:09.613574 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011492 Aug 22 10:59:09.614082 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Mon Aug 22 10:59:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 10:59:09.625827 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-4bbae812-c164-4ce9-bdc0-9d2610cea83d admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 10:59:09.634052 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-4bbae812-c164-4ce9-bdc0-9d2610cea83d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011733 Aug 22 10:59:09.634601 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Mon Aug 22 10:59:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:02:15.181745 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:15.182771 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 22 11:02:15.183177 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 11:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:02:15.324860 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_api:SELECT=6 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:02:15.480510 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:15.482882 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 11:02:15.482882 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: warnings.warn(msg) Aug 22 11:02:15.484048 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:15.484554 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:15.485016 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:15.485733 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:15.486183 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:15.486626 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:15.521491 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-f50c71a0-0cc8-4e46-82aa-48e56a154f01 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198073 Aug 22 11:02:15.522048 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 22 11:02:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:02:16.352600 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:16.353592 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 22 11:02:16.353982 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 11:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:02:16.565011 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:16.567441 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 11:02:16.567441 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: warnings.warn(msg) Aug 22 11:02:16.568587 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:16.569063 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:16.569494 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:16.570219 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:16.570693 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:16.571117 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:16.590445 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-a5f05bb1-e21f-4c1b-a38e-16d07ae98394 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077883 Aug 22 11:02:16.590983 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 22 11:02:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:02:27.827442 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:27.828481 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Aug 22 11:02:27.828872 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 11:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:02:27.972206 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_cell0:SELECT=4 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:02:27.972971 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_cell1:SELECT=4 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:02:27.973597 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG dbcounter [-] [105991] Writing DB stats nova_api:SELECT=8 {{(pid=105991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:02:28.022536 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:28.025005 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 11:02:28.025005 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: warnings.warn(msg) Aug 22 11:02:28.026118 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:28.026614 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:28.027040 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:28.027754 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:28.028323 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:28.028728 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:28.054439 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-71046f42-5ab2-4891-8f77-9d26db7d83e4 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086640 Aug 22 11:02:28.054923 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 22 11:02:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:02:28.875989 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: DEBUG nova.api.openstack.wsgi [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] Calling method '>' {{(pid=105990) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:28.876980 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: INFO nova.api.openstack.requestlog [None req-1dc4f5c1-f3f1-44a7-967c-ef646d369d18 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 22 11:02:28.877370 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: [pid: 105990|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 22 11:02:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:02:29.068248 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG nova.api.openstack.wsgi [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Calling method '>' {{(pid=105991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:02:29.070746 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 11:02:29.070746 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: warnings.warn(msg) Aug 22 11:02:29.071862 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:29.072347 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:29.072787 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:29.073546 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:02:29.074002 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:02:29.074466 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: DEBUG oslo_concurrency.lockutils [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:02:29.096151 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: INFO nova.api.openstack.requestlog [None req-56c9d6e9-440e-4221-a299-1374805f927a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082021 Aug 22 11:02:29.096697 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: [pid: 105991|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 22 11:02:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:03:28.202711 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: Mon Aug 22 11:03:28 2022 - graceful shutdown triggered... Aug 22 11:03:28.203205 dv-cinder-853941-1-iscsi devstack@n-api.service[105990]: Gracefully killing worker 1 (pid: 105990)... Aug 22 11:03:28.202834 dv-cinder-853941-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 11:03:28.204018 dv-cinder-853941-1-iscsi devstack@n-api.service[105991]: Gracefully killing worker 2 (pid: 105991)... Aug 22 11:03:29.203850 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: worker 1 buried after 1 seconds Aug 22 11:03:29.204376 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: worker 2 buried after 1 seconds Aug 22 11:03:29.204376 dv-cinder-853941-1-iscsi devstack@n-api.service[105977]: goodbye to uWSGI. Aug 22 11:03:29.205464 dv-cinder-853941-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 22 11:03:29.206013 dv-cinder-853941-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 11:03:29.208776 dv-cinder-853941-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 11:03:29.218969 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 11:03:29 2022] *** Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: nodename: dv-cinder-853941-1-iscsi Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: machine: x86_64 Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: clock source: unix Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: pcre jit disabled Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: detected number of CPU cores: 4 Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: current working directory: / Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: detected binary path: /usr/bin/uwsgi-core Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: your processes number limit is 47680 Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: your memory page size is 4096 bytes Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: detected max file descriptor number: 2048 Aug 22 11:03:29.221072 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: lock engine: pthread robust mutexes Aug 22 11:03:29.221931 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: thunder lock: enabled Aug 22 11:03:29.221931 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 11:03:29.221931 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 11:03:29.261905 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: Python main interpreter initialized at 0x5608988a49c0 Aug 22 11:03:29.261905 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: python threads support enabled Aug 22 11:03:29.261905 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: your server socket listen backlog is limited to 100 connections Aug 22 11:03:29.261905 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: your mercy for graceful operations on workers is 90 seconds Aug 22 11:03:29.262696 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 11:03:29.262696 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: *** Operational MODE: preforking *** Aug 22 11:03:29.262696 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: *** uWSGI is running in multiple interpreter mode *** Aug 22 11:03:29.262696 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: spawned uWSGI master process (pid: 121125) Aug 22 11:03:29.262956 dv-cinder-853941-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 11:03:29.263485 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: spawned uWSGI worker 1 (pid: 121142, cores: 1) Aug 22 11:03:29.263834 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: spawned uWSGI worker 2 (pid: 121143, cores: 1) Aug 22 11:03:29.264223 dv-cinder-853941-1-iscsi devstack@n-api.service[121125]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 11:03:29.935294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 11:03:29.940939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 11:03:31.108114 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 11:03:31.108114 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: from cryptography.utils import int_from_bytes Aug 22 11:03:31.108744 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 11:03:31.108744 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: from cryptography.utils import int_from_bytes Aug 22 11:03:31.149209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 11:03:31.149209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: from cryptography.utils import int_from_bytes Aug 22 11:03:31.149825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 11:03:31.149825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: from cryptography.utils import int_from_bytes Aug 22 11:03:33.587023 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 11:03:33.587648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 11:03:33.588068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 11:03:33.588192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 11:03:33.593347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 11:03:33.596137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.596137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.596137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.596137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.596137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.596574 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.596852 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.597065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.597489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.597964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.598626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.599072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-1-iscsi {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.599407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.599803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.600382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.600916 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.601418 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.601963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.602527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.603421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.605426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.605653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.606161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.606768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.607384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.607849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.608340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.610623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.610623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.610623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.610623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-1-iscsi {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.610623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.611084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.611380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.611773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.612090 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.612687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.612999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.613591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.613591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.614368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.614368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.615018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.615018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.615584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.615584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.616148 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.616407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.616627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.616933 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.617186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.617497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.617825 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.618220 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.618564 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.619097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.619548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.620237 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.621278 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.621755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.622271 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.622601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.623131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.628208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.628812 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.629338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.629659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.630103 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.630483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.630810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.631298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.632293 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.632603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.633147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.633491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.633839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.634156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.639254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.640914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.641300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.641397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.641760 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.642618 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.643082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.643400 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.643713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.644031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.644342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.644673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.644981 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.645281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.645805 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.646078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.646596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.646980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.647326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.647637 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.647954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.648257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.648565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.648943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.649353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.649858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.650443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.650806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.651113 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.651416 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.651752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.652058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.652357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.652680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.653215 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.653551 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.653869 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.654181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.654609 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.654961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.655288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.655634 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.655954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.656289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.656622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.656940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.657252 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.657623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.657900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.658289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.658480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 11:03:33.658995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.659146 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 11:03:33.659311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.659311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.659610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 11:03:33.659762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.659921 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 11:03:33.659921 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 11:03:33.660201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.660358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.660808 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.660970 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.661136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.661288 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.661442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.661646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.661801 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.661980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.662149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.662325 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.662471 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.662656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.663151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.663333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.663480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.663480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.663788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.663942 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-1-iscsi {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.664094 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.664248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.664762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.664925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.665090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.665317 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.665485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.665715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.665869 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.666076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.666363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.666531 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.666686 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.666911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.667707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.668048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.668306 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.668482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.668818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.669016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.669186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.669347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.669347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.669636 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.669787 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.669956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.670148 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.670450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.670688 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.671193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.671356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.671509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.671697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-1-iscsi {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.671697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.671989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.672188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.672188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.672486 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.672730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.672904 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.675534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.675718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.675879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.675879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.676240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.676400 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.676565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.676710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.676860 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.677070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.677287 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.677440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.677594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.677808 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.678066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.678541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.678786 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.679019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.679328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.679493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.679690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.679934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.680189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.680482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.680649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.680795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.680968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.681446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.681446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.681740 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.681893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.682055 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.682210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.682391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.682579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.682732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.683585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.683764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.683940 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.684108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.685270 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.686016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.686171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.686431 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.686581 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.686745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.686890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.686890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.687171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.687171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.687461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.687653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.687815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.687967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.687967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.688356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.688632 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.688784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.688936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.689124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.689289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.689441 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.689592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.689742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.689887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.690036 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.690195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.692128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.692300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.692469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.694365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.694365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696448 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.696615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.696859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.697730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.697730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.697998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.698111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.698111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.702388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.702583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.702760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.702963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.703125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.703282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.703434 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.703594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.703748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.703900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.704099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.704283 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.704283 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.704590 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.704775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.705000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.705238 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.705489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.705737 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.706851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.707099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.707355 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.707540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.707692 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.707849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.708006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.708160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.708312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.708504 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.708655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.708655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.709173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.709321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.709465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.709617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.709762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.709930 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.710084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.710291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.710444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.710678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.710830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.711853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.712536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.712916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.713082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.713242 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.713388 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.713550 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.713550 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.713831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.713984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.714165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.714398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.714545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.714689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.715021 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.715168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.715321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.715485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.715637 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.715781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.715924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.716075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.716659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.717196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.717464 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.717643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.717803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.717970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.718114 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.718309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.718309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.718599 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.718758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.718928 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.719176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.719352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.719582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.719747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.719906 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.720070 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.720070 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.720360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.720503 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.720660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.720804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.720804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.721090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.721234 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.721377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.721377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.721657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.721806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.721806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.722088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.722612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.722724 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.722826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.722907 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.722986 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.723170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.723357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.723526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723618 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.723703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 11:03:33.723890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.724931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725219 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725514 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725587 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725657 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.725949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726021 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.726967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.727990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728063 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728063 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728190 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728414 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728790 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.728990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729223 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.729609 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.730624 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.730624 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.730763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.730842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.730842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731084 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.731904 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734296 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.734994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735233 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735389 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735458 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735834 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.735985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.736120 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.736261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.736414 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.736577 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.737704 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.737813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.737890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.737961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738043 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738313 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.738968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.739276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.739439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.739587 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.739839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.740010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.740172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.740349 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.740508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.740661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.742410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.742596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.742756 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.742942 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.743088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.743240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.743386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.743909 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.743909 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.744621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.744770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.744921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.745065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.745222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.745472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.745638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.745958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.748997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.751350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.751350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.751350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.751350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.751350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.753141 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.753289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.753445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.753596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.753596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.753878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754038 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754385 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754500 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.754992 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755517 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755599 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.755941 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756531 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.756999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757139 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.757730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.758056 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.758508 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.758653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.759066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.764799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.765006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.765226 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.765405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.765569 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.765720 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.765867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.766021 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.766195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.766382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.766530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.766686 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.766895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.767043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.767205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.767205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.767861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.768956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.769506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.769654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.769806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.769951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.770103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.770266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.770429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.770583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.770738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.770902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.771055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.771208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.771208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.771492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.771645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.771873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.772031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.772188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.772188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.772484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.772629 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.772775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773511 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.773953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.775424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.775424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.775424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.775424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.775424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.776186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.776333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.776333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.776700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.776858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.777005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.777176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.777329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.777526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.777526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.778264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.778438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.778438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.778713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.778857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.779054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.779501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.779676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.779824 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.779988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.780135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.780135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.780415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.781158 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.781158 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.781469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.781622 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.781775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.781927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.782078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.782262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.782659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.782825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.782825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.783299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.783511 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.783511 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.783814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.783814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.784103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.784103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.784391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.784556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.784556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.785320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.785320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.785619 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.785619 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.785921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.786130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.786130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.788710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.788884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.788884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.789203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.789372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.799359 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.799515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.799515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.799708 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.799820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.799919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800219 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.800924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.801010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.801103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.801209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.801297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.801392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.801485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802322 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802675 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.802978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803122 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803339 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.803893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804104 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804243 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804406 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804640 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.804999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805361 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805658 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805743 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805894 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.805974 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806053 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806416 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.806898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.807225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.807225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.807544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.807710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.808559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.808666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.808666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.808813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.808813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.808957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.809719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810180 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810462 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810740 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.810917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811355 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811639 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811829 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.811920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812359 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812602 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.812930 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813502 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813572 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813877 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.813946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814029 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814676 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814756 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.814847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815046 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815322 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815414 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815947 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.815947 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816286 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.816958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.817056 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.817211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.817342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.817662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.817831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.818070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.818368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.818548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.818719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.818916 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.819039 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.819356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.819465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.819827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.819944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.820340 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.820448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.820736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.820875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.821057 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.821812 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.821932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822011 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822095 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822463 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822871 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.822996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.823888 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.824219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.824415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.824744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.824995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.825323 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.825457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.825824 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.825943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.826336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.826461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.826972 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.827105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.827388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.827960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.828530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.828909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.829117 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.829443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.829611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.829955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.830180 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.830506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.830938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.831064 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.831655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.831799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.832179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.832400 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.832650 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.832755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.833079 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.833181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.833403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.833628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.833724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.834100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.834195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.834599 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.834782 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.835080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.835367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.835551 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.835812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.836023 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.836137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.836520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.836629 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.836997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.837168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.837474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.837674 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.837951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.838094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.838279 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.838497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.838754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.839069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.839887 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.840211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.840448 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.840773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.840886 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.841303 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.841431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.841855 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.841949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.842476 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.842575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.843041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.843224 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.843591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.843770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.844160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.844308 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.844749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.845019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.845311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.845540 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.845841 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.846081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.846192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.846494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.846757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.846851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.847157 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.847343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.851062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.851239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.851415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.851620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.851768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.851928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.852098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.852311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.852532 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.852797 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.853058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.853317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.853583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.853822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.853822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.854198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.854411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.854591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.855024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.855458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.855905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.856075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.856319 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.856487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.856649 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.856805 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.856968 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.857153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.857421 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.857579 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.858481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.858655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.858828 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.858989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.859151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.859729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.859882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.859882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.860506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.860651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.860815 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.861108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.861108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.861561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.861822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.862095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.862630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.862919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.863643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.866210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.866210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.866546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.866546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.867970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868334 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868334 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.868563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.871551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.871551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.871551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.871551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.871551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.871551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.872348 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.872510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.872680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.872855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.872855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.873147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.873319 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.873484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874371 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874663 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874836 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.874922 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.875977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876293 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876366 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876728 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.876918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877237 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877675 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.877933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878316 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.878680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.879249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.879416 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.879588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.879588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.879816 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880237 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880674 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.880904 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.881174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.881321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.881462 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.881619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.881761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.881902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882057 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882409 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882692 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.882955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883125 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.883913 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.884064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.884230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.884453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.884719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.885151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.885248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.885683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.885767 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.886718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.886858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.887060 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.887329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.887626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.887796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.887951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.888047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.888265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.888347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.888668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.888762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.888994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.889338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.889473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.889614 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.889794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.889927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.890130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.890278 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.890451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.890770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.890852 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.891087 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.891235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.891419 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.891509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.891733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.891834 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.892042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.892134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.892353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.892434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.892664 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.892744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.893201 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.893293 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.893518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.893628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.893854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.893936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.894179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.894566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.894668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.894892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.895188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.895297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.895520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.895743 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.895874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.896187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.896320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.896493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.896632 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.896802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.896991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.897152 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.897475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.897575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.897779 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.898098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.898262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.898507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.898799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.898899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.899118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.899343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.899602 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.900011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.900241 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.900440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.900654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.900796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.900971 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.901120 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.901289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.901666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.901875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.902092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.902305 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.902496 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.902690 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.902883 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.902977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.903071 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.903239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.903596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.903706 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.903855 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.904018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.904166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.904406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.904499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.904717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.904822 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.905059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.905150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.905368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.905449 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.905674 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.905756 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906012 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906300 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906396 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.906944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907252 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907558 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907650 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.907968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.908172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.908279 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.908475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.908567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.908780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.908879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.909083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.909184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.909393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.909492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.909791 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.909889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.910332 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.910507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.910653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.910796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.911019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.911218 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.911389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.911561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.911717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.911913 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.912070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.912257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.912549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.912713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.912874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.913009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.913208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.913300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.913519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.913670 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.913886 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914120 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914594 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.914873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.915080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.915185 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.915390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.915487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.915696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.915977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.916081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.916302 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.916397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.916610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.916703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.916921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917364 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917900 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.917994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.918204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.918320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.918547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.918644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.918857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.918967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.919166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.919268 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.919474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.919570 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.919782 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.919886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.920089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.920216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.920394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.920526 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.920703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.920833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921303 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921517 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921619 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.921933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.922159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.922289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.922510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.922622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.922815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.922925 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.923126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.923241 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.923465 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.923569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.923785 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924259 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.924833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925328 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925454 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925635 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.925941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.926080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.926301 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.926435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.926588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.926786 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.926954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.927103 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.927207 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.927424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.927606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.927729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.927918 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.928965 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.929181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.929282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.929496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.929589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.929793 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.929901 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.930099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.930191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.930426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.930538 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.930730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.930931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.931083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.931530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.931673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.931883 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.932083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.932178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.932480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.932604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.933304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.933607 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.933715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.933933 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.934213 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.934395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.934518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.934760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.934875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.935110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.935326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.935420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.935699 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.935879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.936000 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.936299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.936424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.936629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.936964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.937067 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.937275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.937518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.937612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.937890 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.938080 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.938208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.938540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.938717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.938861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.939179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.939316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.939494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.939801 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.939917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.940133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.940442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.940549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.940751 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941060 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941152 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941376 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.941968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.942121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.942328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.942926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.943368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.943528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.943668 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.943772 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.943911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.944473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.944604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.944751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.944879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.944979 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945244 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945491 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945764 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.945964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946458 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946686 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.946938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.947071 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.947212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.947473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.947713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.947968 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.948300 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.949219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.949518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.949828 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.950143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.950478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.950791 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.951123 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.951453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.951618 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.951759 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.951967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.952065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.952318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.952413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.952683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.952775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.952997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.953100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.953308 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.953410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.953647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.953777 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.953951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.954153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.954275 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.954550 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.954666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.954991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.955156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.955156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.955444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.955605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.955763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.955923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.956079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.956176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.956261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.956344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.956595 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 11:03:33.956786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.956970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.957294 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.957604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.957925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.958284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.958612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.958921 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.959263 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.959585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.959900 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.960210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.960512 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 11:03:33.960752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 11:03:34.028083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO dbcounter [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Registered counter for database nova_api Aug 22 11:03:34.045652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Registered counter for database nova_api Aug 22 11:03:34.050562 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.061149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writer thread running {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.071266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.085569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.127154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.context [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4636e7ec-f34c-4137-85d0-63ba3e40bf57(cell1) {{(pid=121143) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 11:03:34.131284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:03:34.131776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:03:34.133366 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:03:34.134118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:03:34.134593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:03:34.136873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:03:34.138919 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO dbcounter [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Registered counter for database nova_cell0 Aug 22 11:03:34.143129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO dbcounter [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Registered counter for database nova_cell1 Aug 22 11:03:34.152260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.153759 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.160623 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writer thread running {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.167347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.context [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4636e7ec-f34c-4137-85d0-63ba3e40bf57(cell1) {{(pid=121142) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 11:03:34.170380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writer thread running {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.174311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:03:34.175155 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:03:34.177335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:03:34.178831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:03:34.178831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:03:34.180960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:03:34.188429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Registered counter for database nova_cell0 Aug 22 11:03:34.193975 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Registered counter for database nova_cell1 Aug 22 11:03:34.207315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.209613 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.213558 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.346174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO dbcounter [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Registered counter for database nova_cell0 Aug 22 11:03:34.352876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_db.sqlalchemy.engines [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.357947 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writer thread running {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.374568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.383476 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Registered counter for database nova_cell0 Aug 22 11:03:34.390341 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 11:03:34.394974 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 11:03:34.690510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: WARNING keystonemiddleware.auth_token [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 11:03:34.697786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: WARNING keystonemiddleware.auth_token [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 11:03:34.719379 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 11:03:34.727266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 11:03:35.050764 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: WARNING keystonemiddleware.auth_token [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 11:03:35.057115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: WARNING keystonemiddleware.auth_token [None req-7fa38731-c3f3-42e5-8f9c-6fa9ffa84aea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 11:03:35.062569 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608988a49c0 pid: 121143 (default app) Aug 22 11:03:35.075162 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 11:03:35.081177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-c1e2a93f-fdff-45a4-924c-e15e1573fb33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 11:03:35.086521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608988a49c0 pid: 121142 (default app) Aug 22 11:04:11.447633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.448703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.450044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.450795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.454928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.454928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.455430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:11.457641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:12.661550 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b1c612ef-e02f-4907-8678-fb2072acc2af tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Action: 'create', calling method: .version_select at 0x7f3b4e778700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2044712608"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:12.916276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a106145-71c6-4bd4-8115-c9175af962e0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Action: 'create', calling method: .version_select at 0x7f3b4e6fc5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1632412948", "metadata": {"Type": "work"}}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a106145-71c6-4bd4-8115-c9175af962e0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Request method failure captured: Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 122 Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Kr6tQaCKkrFzUfqANf-6Bg2uMMsflJIzHeIwQPAAetyAF7Fv7zYSspBlyCw7vtVrR4xf7t3fUQToLp-LFLu5SIt07sO2nTVYEbjLeS_nf3w7EpT2oeER7xgHFYxqiTvCwtOcSExkHZiQvsZ2z6MUTCQ80IHGGKcWtTBDody-5Mb9k Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:12.924560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d88aee438994d1b96443472f132ea77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d88aee438994d1b96443472f132ea77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: fd597b7fd9414dcab382940be9c14106 Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1632412948", "metadata": {"Type": "work"}}} Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:12.931375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1632412948', 'metadata': {'Type': 'work'}}}} Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise error Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:12.932765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 11:04:12.934092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 11:04:12.935285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 11:04:12.935285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.935285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a106145-71c6-4bd4-8115-c9175af962e0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:12.935285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a106145-71c6-4bd4-8115-c9175af962e0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.494307 Aug 22 11:04:12.935285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 22 11:04:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1496 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:04:12.941093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f58ed60b-0166-4edc-99a5-5b90eb950293 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Action: 'create', calling method: .version_select at 0x7f3b4e6fc670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-82020149", "metadata": {"Type": "work"}}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f58ed60b-0166-4edc-99a5-5b90eb950293 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Request method failure captured: Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 118 Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Kr6tQaCKkrFzUfqANf-6Bg2uMMsflJIzHeIwQPAAetyAF7Fv7zYSspBlyCw7vtVrR4xf7t3fUQToLp-LFLu5SIt07sO2nTVYEbjLeS_nf3w7EpT2oeER7xgHFYxqiTvCwtOcSExkHZiQvsZ2z6MUTCQ80IHGGKcWtTBDody-5Mb9k Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:12.945375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d88aee438994d1b96443472f132ea77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d88aee438994d1b96443472f132ea77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: fd597b7fd9414dcab382940be9c14106 Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-82020149", "metadata": {"Type": "work"}}} Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:12.946948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-82020149', 'metadata': {'Type': 'work'}}}} Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise error Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi '0' Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:12.948013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 11:04:12.949269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 11:04:12.951466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 11:04:12.951466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.951466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f58ed60b-0166-4edc-99a5-5b90eb950293 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:12.951466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f58ed60b-0166-4edc-99a5-5b90eb950293 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010618 Aug 22 11:04:12.952099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 22 11:04:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:04:12.958166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a8b6af7b-4ae5-4460-85b9-1cc0a9718ad0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Action: 'create', calling method: .version_select at 0x7f3b4e63a1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1295079304", "metadata": {"Type": "work"}}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a8b6af7b-4ae5-4460-85b9-1cc0a9718ad0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Request method failure captured: Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 119 Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Kr6tQaCKkrFzUfqANf-6Bg2uMMsflJIzHeIwQPAAetyAF7Fv7zYSspBlyCw7vtVrR4xf7t3fUQToLp-LFLu5SIt07sO2nTVYEbjLeS_nf3w7EpT2oeER7xgHFYxqiTvCwtOcSExkHZiQvsZ2z6MUTCQ80IHGGKcWtTBDody-5Mb9k Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:12.961954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d88aee438994d1b96443472f132ea77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d88aee438994d1b96443472f132ea77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: fd597b7fd9414dcab382940be9c14106 Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1295079304", "metadata": {"Type": "work"}}} Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:12.964020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1295079304', 'metadata': {'Type': 'work'}}}} Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise error Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi '' Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:12.964782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 11:04:12.966769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 11:04:12.969201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 11:04:12.969201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:12.969201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a8b6af7b-4ae5-4460-85b9-1cc0a9718ad0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:12.969201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a8b6af7b-4ae5-4460-85b9-1cc0a9718ad0 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010474 Aug 22 11:04:12.969748 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 22 11:04:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:04:12.974880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-274ff4ef-6eb3-46ad-8914-96a4aef1809f tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Calling method '.version_select at 0x7f3b4e63ab80>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:14.016515 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-274ff4ef-6eb3-46ad-8914-96a4aef1809f tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] HTTP exception thrown: Volume tempest-invalid-976154137 could not be found. Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-274ff4ef-6eb3-46ad-8914-96a4aef1809f tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Request method failure captured: Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-976154137 HTTP/1.1 Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Kr6tQaCKkrFzUfqANf-6Bg2uMMsflJIzHeIwQPAAetyAF7Fv7zYSspBlyCw7vtVrR4xf7t3fUQToLp-LFLu5SIt07sO2nTVYEbjLeS_nf3w7EpT2oeER7xgHFYxqiTvCwtOcSExkHZiQvsZ2z6MUTCQ80IHGGKcWtTBDody-5Mb9k Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:14.020336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d88aee438994d1b96443472f132ea77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d88aee438994d1b96443472f132ea77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: fd597b7fd9414dcab382940be9c14106 Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Volume tempest-invalid-976154137 could not be found. Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'tempest-invalid-976154137'} Aug 22 11:04:14.027612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-976154137 could not be found. (HTTP 404) (Request-ID: req-b5bf6d85-43fd-43b5-8e25-00a7077910da) Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.028545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 11:04:14.029911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-976154137 could not be found. Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:14.031328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-976154137 could not be found. Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-976154137 could not be found. Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-274ff4ef-6eb3-46ad-8914-96a4aef1809f tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Returning 404 to user: Volume tempest-invalid-976154137 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-274ff4ef-6eb3-46ad-8914-96a4aef1809f tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-976154137" status: 404 len: 98 microversion: 2.1 time: 1.051294 Aug 22 11:04:14.033426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Aug 22 11:04:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-976154137 => generated 98 bytes in 1058 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 11:04:14.042697 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-123294c9-141b-4cbe-b28b-fecc21bf2225 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012661 Aug 22 11:04:14.052271 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 22 11:04:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 11:04:14.061663 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1318edc4-0bac-42c1-ba1e-87231816a107 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006290 Aug 22 11:04:14.078467 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Aug 22 11:04:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 11:04:14.091226 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f752b79-c63d-49de-a113-9afec8fc80e1 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Calling method '.version_select at 0x7f3b4e56e550>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-0f752b79-c63d-49de-a113-9afec8fc80e1 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] HTTP exception thrown: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f752b79-c63d-49de-a113-9afec8fc80e1 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Request method failure captured: Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/os-volumes/ee8b83c6-792c-4e5e-9952-dfcd6189a642 HTTP/1.1 Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Kr6tQaCKkrFzUfqANf-6Bg2uMMsflJIzHeIwQPAAetyAF7Fv7zYSspBlyCw7vtVrR4xf7t3fUQToLp-LFLu5SIt07sO2nTVYEbjLeS_nf3w7EpT2oeER7xgHFYxqiTvCwtOcSExkHZiQvsZ2z6MUTCQ80IHGGKcWtTBDody-5Mb9k Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:14.563814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d88aee438994d1b96443472f132ea77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d88aee438994d1b96443472f132ea77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: fd597b7fd9414dcab382940be9c14106 Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'ee8b83c6-792c-4e5e-9952-dfcd6189a642'} Aug 22 11:04:14.576755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. (HTTP 404) (Request-ID: req-33e5a91e-6038-4355-9f9c-b24b75115726) Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.583480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 11:04:14.587422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 11:04:14.589753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f752b79-c63d-49de-a113-9afec8fc80e1 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Returning 404 to user: Volume ee8b83c6-792c-4e5e-9952-dfcd6189a642 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0f752b79-c63d-49de-a113-9afec8fc80e1 tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/ee8b83c6-792c-4e5e-9952-dfcd6189a642" status: 404 len: 109 microversion: 2.1 time: 0.373567 Aug 22 11:04:14.594263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:04:14 2022] DELETE /compute/v2.1/os-volumes/ee8b83c6-792c-4e5e-9952-dfcd6189a642 => generated 109 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:04:14.596068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ab56719-7f9c-48b0-9575-3041819b0cba tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Calling method '.version_select at 0x7f3b4e56e820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:14.710361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-9ab56719-7f9c-48b0-9575-3041819b0cba tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] HTTP exception thrown: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ab56719-7f9c-48b0-9575-3041819b0cba tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Request method failure captured: Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/bd3bac9a-899f-40d3-90e0-5aa14632d528 HTTP/1.1 Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Kr6tQaCKkrFzUfqANf-6Bg2uMMsflJIzHeIwQPAAetyAF7Fv7zYSspBlyCw7vtVrR4xf7t3fUQToLp-LFLu5SIt07sO2nTVYEbjLeS_nf3w7EpT2oeER7xgHFYxqiTvCwtOcSExkHZiQvsZ2z6MUTCQ80IHGGKcWtTBDody-5Mb9k Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:14.712501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d88aee438994d1b96443472f132ea77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d88aee438994d1b96443472f132ea77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d88aee438994d1b96443472f132ea77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7d88aee438994d1b96443472f132ea77 Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-1253905674 Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: fd597b7fd9414dcab382940be9c14106 Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-1253905674-project Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'bd3bac9a-899f-40d3-90e0-5aa14632d528'} Aug 22 11:04:14.714295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. (HTTP 404) (Request-ID: req-3c6ecfa4-cad2-4ac5-ac19-a199489a9f69) Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.718270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:14.719138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 11:04:14.720447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ab56719-7f9c-48b0-9575-3041819b0cba tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] Returning 404 to user: Volume bd3bac9a-899f-40d3-90e0-5aa14632d528 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:14.721327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9ab56719-7f9c-48b0-9575-3041819b0cba tempest-VolumesNegativeTest-1253905674 tempest-VolumesNegativeTest-1253905674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bd3bac9a-899f-40d3-90e0-5aa14632d528" status: 404 len: 109 microversion: 2.1 time: 0.243771 Aug 22 11:04:14.731198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:04:14 2022] GET /compute/v2.1/os-volumes/bd3bac9a-899f-40d3-90e0-5aa14632d528 => generated 109 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:04:15.175980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b1c612ef-e02f-4907-8678-fb2072acc2af tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.743841 Aug 22 11:04:15.176593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Aug 22 11:04:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3746 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 11:04:15.193565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e67dcaf0-f3be-4979-a94a-bcd31f880d91 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e63aee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:15.320817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e67dcaf0-f3be-4979-a94a-bcd31f880d91 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6" status: 200 len: 345 microversion: 2.1 time: 0.131499 Aug 22 11:04:15.321731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:04:15 2022] GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:16.337670 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8efc4d2b-5bc7-40b0-a978-5bed6eeb5fba tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5d34c0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:16.438433 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8efc4d2b-5bc7-40b0-a978-5bed6eeb5fba tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6" status: 200 len: 346 microversion: 2.1 time: 0.105657 Aug 22 11:04:16.439004 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:04:16 2022] GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:04:16.453595 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ffacb0e8-ff26-418e-b006-7ba38ebe8d27 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Action: 'create', calling method: .version_select at 0x7f3b4e56ea60>, body: {"snapshot": {"volume_id": "5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-725646242"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:17.234899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ffacb0e8-ff26-418e-b006-7ba38ebe8d27 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.787180 Aug 22 11:04:17.242045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 10/12] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Aug 22 11:04:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:17.246858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-183168db-898e-4503-b04f-28d7b191e43c tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5d3940>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:17.391164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-183168db-898e-4503-b04f-28d7b191e43c tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 286 microversion: 2.1 time: 0.147984 Aug 22 11:04:17.392211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 3/13] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:17 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:17.403613 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cda5fe8d-2ffe-49f3-8cf1-14fc61bc1e7f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56f280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:17.473499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cda5fe8d-2ffe-49f3-8cf1-14fc61bc1e7f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.074490 Aug 22 11:04:17.474953 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 22 11:04:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:17.488595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-55aada80-2ad7-4868-9c61-a555d539c52f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5e70d0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:17.560217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-55aada80-2ad7-4868-9c61-a555d539c52f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 286 microversion: 2.1 time: 0.075436 Aug 22 11:04:17.561229 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:17 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:18.577784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-efa6193b-20eb-4539-b588-d7957b83550a tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56f790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:18.665371 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-efa6193b-20eb-4539-b588-d7957b83550a tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 286 microversion: 2.1 time: 0.095855 Aug 22 11:04:18.666793 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:18 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:19.680171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-48438f74-00e4-4b7d-a73f-bc1f14cbfca5 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5e7790>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:19.772050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-48438f74-00e4-4b7d-a73f-bc1f14cbfca5 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 286 microversion: 2.1 time: 0.091048 Aug 22 11:04:19.772050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:19 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:20.781673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f869b3d8-9afa-4517-a214-07a6ca64b5e4 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56e310>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:20.895176 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f869b3d8-9afa-4517-a214-07a6ca64b5e4 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 286 microversion: 2.1 time: 0.119809 Aug 22 11:04:20.900291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 13/18] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:20 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:21.909073 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2fc81e70-ccd2-492d-9675-788f9982ecbb tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5d3a60>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:21.996722 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2fc81e70-ccd2-492d-9675-788f9982ecbb tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 287 microversion: 2.1 time: 0.091787 Aug 22 11:04:22.003893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 6/19] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:21 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:22.009766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fdc01f69-c29f-4a88-af99-46250a20f18b tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56e700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:22.205006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fdc01f69-c29f-4a88-af99-46250a20f18b tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 202 len: 0 microversion: 2.1 time: 0.199558 Aug 22 11:04:22.205711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 14/20] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Aug 22 11:04:22 2022] DELETE /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:04:22.218563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ff27567d-40a5-4686-b483-e46d7697a80f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5d33a0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:22.285271 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ff27567d-40a5-4686-b483-e46d7697a80f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 200 len: 286 microversion: 2.1 time: 0.070351 Aug 22 11:04:22.286466 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 7/21] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:22 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:23.299260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b3fe491-62d3-4145-a70c-ae3bea253b25 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56e940>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:23.355434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-3b3fe491-62d3-4145-a70c-ae3bea253b25 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] HTTP exception thrown: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b3fe491-62d3-4145-a70c-ae3bea253b25 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Request method failure captured: Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 HTTP/1.1 Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2KroreuC16CA97LOB7MKveRSgmxNs5LIeYk0DEyZYUV_huSsCzN-WeQlpUmEh9ns_xHAxUCWx-Gkzk1-YPXoBhHZ1s1KeiW9zKxpAs35CbaIoD2Pvyfe_D0qiYJxR7gy8VPJnrqK_8zrQWX3VI4CacP0SC2B-8Ck91Hm1ZvjzWBqPQ Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:23.357651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b2fee426407b48138c95541c02b38637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b2fee426407b48138c95541c02b38637", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 6e9ddaf55d0a48219dbe517c7ff4aa32 Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'd714bfe3-d860-4569-832c-889f183d1059'} Aug 22 11:04:23.358704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. (HTTP 404) (Request-ID: req-0eb6a6c5-ec22-4581-92c6-32fbd20772dd) Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.359363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:23.360213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 11:04:23.361390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b3fe491-62d3-4145-a70c-ae3bea253b25 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Returning 404 to user: Snapshot d714bfe3-d860-4569-832c-889f183d1059 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:23.362315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b3fe491-62d3-4145-a70c-ae3bea253b25 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059" status: 404 len: 111 microversion: 2.1 time: 0.065404 Aug 22 11:04:23.362983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 15/22] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 22 11:04:23 2022] GET /compute/v2.1/os-snapshots/d714bfe3-d860-4569-832c-889f183d1059 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:04:23.371861 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-55ce1c16-87c5-432a-b18d-9f3cc7e3bed2 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5e7940>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:23.689267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-55ce1c16-87c5-432a-b18d-9f3cc7e3bed2 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6" status: 202 len: 0 microversion: 2.1 time: 0.324058 Aug 22 11:04:23.693731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 8/23] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:04:23 2022] DELETE /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:04:23.699572 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b0f28cf-b795-44da-8ae0-3820ddf3c9d3 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56ee50>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:24.200295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-2b0f28cf-b795-44da-8ae0-3820ddf3c9d3 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] HTTP exception thrown: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b0f28cf-b795-44da-8ae0-3820ddf3c9d3 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Request method failure captured: Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 HTTP/1.1 Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2KroreuC16CA97LOB7MKveRSgmxNs5LIeYk0DEyZYUV_huSsCzN-WeQlpUmEh9ns_xHAxUCWx-Gkzk1-YPXoBhHZ1s1KeiW9zKxpAs35CbaIoD2Pvyfe_D0qiYJxR7gy8VPJnrqK_8zrQWX3VI4CacP0SC2B-8Ck91Hm1ZvjzWBqPQ Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:24.202742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b2fee426407b48138c95541c02b38637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b2fee426407b48138c95541c02b38637", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 6e9ddaf55d0a48219dbe517c7ff4aa32 Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6'} Aug 22 11:04:24.208972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. (HTTP 404) (Request-ID: req-12560c8a-d287-48dd-921f-6d45c4c7f095) Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.209616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:24.210527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 11:04:24.211439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b0f28cf-b795-44da-8ae0-3820ddf3c9d3 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Returning 404 to user: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2b0f28cf-b795-44da-8ae0-3820ddf3c9d3 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6" status: 404 len: 109 microversion: 2.1 time: 0.509272 Aug 22 11:04:24.214425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 16/24] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:04:23 2022] GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 => generated 109 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:04:24.223777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f898c162-d3e9-472c-8e1a-8d01ecc62b5f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e5e7160>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:24.385522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-f898c162-d3e9-472c-8e1a-8d01ecc62b5f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] HTTP exception thrown: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f898c162-d3e9-472c-8e1a-8d01ecc62b5f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Request method failure captured: Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 HTTP/1.1 Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2KroreuC16CA97LOB7MKveRSgmxNs5LIeYk0DEyZYUV_huSsCzN-WeQlpUmEh9ns_xHAxUCWx-Gkzk1-YPXoBhHZ1s1KeiW9zKxpAs35CbaIoD2Pvyfe_D0qiYJxR7gy8VPJnrqK_8zrQWX3VI4CacP0SC2B-8Ck91Hm1ZvjzWBqPQ Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:04:24.391646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b2fee426407b48138c95541c02b38637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b2fee426407b48138c95541c02b38637", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 6e9ddaf55d0a48219dbe517c7ff4aa32 Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6'} Aug 22 11:04:24.392701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. (HTTP 404) (Request-ID: req-f8914973-d881-4073-82b7-6fbe7b34d20e) Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.393777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 11:04:24.394927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 11:04:24.395754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.397621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.399364 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f898c162-d3e9-472c-8e1a-8d01ecc62b5f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Returning 404 to user: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:24.401068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f898c162-d3e9-472c-8e1a-8d01ecc62b5f tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6" status: 404 len: 109 microversion: 2.1 time: 0.183311 Aug 22 11:04:24.402281 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 9/25] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:04:24 2022] DELETE /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 => generated 109 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:04:24.414842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-07b4c102-aaea-451d-ae0a-6d03dc9e0205 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Calling method '.version_select at 0x7f3b4e56ee50>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:24.567916 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-07b4c102-aaea-451d-ae0a-6d03dc9e0205 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] HTTP exception thrown: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-07b4c102-aaea-451d-ae0a-6d03dc9e0205 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Request method failure captured: Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 HTTP/1.1 Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2KroreuC16CA97LOB7MKveRSgmxNs5LIeYk0DEyZYUV_huSsCzN-WeQlpUmEh9ns_xHAxUCWx-Gkzk1-YPXoBhHZ1s1KeiW9zKxpAs35CbaIoD2Pvyfe_D0qiYJxR7gy8VPJnrqK_8zrQWX3VI4CacP0SC2B-8Ck91Hm1ZvjzWBqPQ Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:04:24.570347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b2fee426407b48138c95541c02b38637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b2fee426407b48138c95541c02b38637", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b2fee426407b48138c95541c02b38637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: b2fee426407b48138c95541c02b38637 Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1963067397 Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 6e9ddaf55d0a48219dbe517c7ff4aa32 Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1963067397-project Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6'} Aug 22 11:04:24.571353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. (HTTP 404) (Request-ID: req-d2906ac0-1b22-450a-ae9f-f0f6729f21fd) Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.572818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:04:24.573792 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 11:04:24.575566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. Aug 22 11:04:24.577242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:04:24.578776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-07b4c102-aaea-451d-ae0a-6d03dc9e0205 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] Returning 404 to user: Volume 5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:04:24.580125 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-07b4c102-aaea-451d-ae0a-6d03dc9e0205 tempest-VolumesSnapshotsTestJSON-1963067397 tempest-VolumesSnapshotsTestJSON-1963067397-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6" status: 404 len: 109 microversion: 2.1 time: 0.172714 Aug 22 11:04:24.580820 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 17/26] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:04:24 2022] GET /compute/v2.1/os-volumes/5f7d0ed7-b032-4dc9-ae49-b9c114e65fe6 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 11:04:25.351155 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1483220004", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:25.632377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] validate_networks() for [('b914a658-1e38-4bf2-b0cc-742447239f97', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:04:26.962896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-564f7375-b3ac-4be0-927b-e307c4026511 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'create', calling method: .version_select at 0x7f3b4e56fdc0>, body: {"keypair": {"name": "tempest-keypair-906534526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5xZhPBtY38kfYBJuKBCW2MjGNz/Eenin/6UC/b5SbSjKoE82YZUBF7C+GiZgVm2IYY27gIneL5KFiN4XaIfYamsmf0z3WBWItok+aLHLqh7t60ciWBYewLVA5GxP8NbQ=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:27.116848 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-564f7375-b3ac-4be0-927b-e307c4026511 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:27.156985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-564f7375-b3ac-4be0-927b-e307c4026511 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for user d13b7df898df4d238ea290fab8edc4a7 and project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:27.395695 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-564f7375-b3ac-4be0-927b-e307c4026511 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.791918 Aug 22 11:04:27.401798 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 18/27] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 22 11:04:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1795 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 11:04:27.907764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1003171092", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "networks": [{"uuid": "7b1e29e1-7046-4879-9bf3-3b7f8a1276e5"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:28.169705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] validate_networks() for [('7b1e29e1-7046-4879-9bf3-3b7f8a1276e5', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:04:28.293528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:04:28.294210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:04:28.294781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:04:28.295312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:04:28.295797 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:04:28.325662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:28.327549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:28.328997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:28.329836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:28.332029 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:28.332647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:28.423326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:28.463251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for user 7c6fee0b956e41a7b2d9b914043633ea and project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:28.492892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:04:28.502415 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:04:28.818030 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-784818f5-9a12-45d4-b7c1-9e4f67bc8f39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.008804 Aug 22 11:04:28.831911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 10/28] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:04:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 4024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:04:29.154425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-68ac9346-6179-4db0-8386-d5b291ad9ba9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: .version_select at 0x7f3b4dc4ee50>, body: {"keypair": {"name": "tempest-keypair-1280105896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn6M+9NEctdcxVpabjAVrpmBNAcRooizPOzEHF3BfVVomQcO3TNS6OQsJhdpxPx8WeC+Tvf4Jhxmbsrjb/DBQx+wTsHdAXRnkfx1GlTHGSq51E0QDiIWQs9ZL+ADzw4BQ=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:29.226396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-68ac9346-6179-4db0-8386-d5b291ad9ba9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:29.244249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-68ac9346-6179-4db0-8386-d5b291ad9ba9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:29.495365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-68ac9346-6179-4db0-8386-d5b291ad9ba9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.661402 Aug 22 11:04:29.503607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 11/29] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:04:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:29.509087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d2543198-c447-4cfd-906f-488a188f6b16 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:29.511737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d2543198-c447-4cfd-906f-488a188f6b16 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:29.936881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d2543198-c447-4cfd-906f-488a188f6b16 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:29.978565 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d2543198-c447-4cfd-906f-488a188f6b16 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1222 microversion: 2.1 time: 0.472821 Aug 22 11:04:29.997331 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 12/30] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:29 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1222 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:30.318984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1988617917", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:30.444718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] validate_networks() for [('b914a658-1e38-4bf2-b0cc-742447239f97', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:04:30.709126 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:04:30.710297 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:04:30.713520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:04:30.714621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:04:30.715197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:04:30.729689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:30.736047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:30.736047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:30.736047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:30.736047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:30.736673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:30.786391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Getting quotas for project 793621196ef245588f21b7982fe651e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:30.792599 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Getting quotas for user 7acea30e695341c8a1d83f386629a99b and project 793621196ef245588f21b7982fe651e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:30.827412 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:04:30.831709 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:04:31.134525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2fe2c477-6760-4e06-a6e4-00d70bfe6943 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.734691 Aug 22 11:04:31.135790 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 19/31] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:04:31.150400 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f257729d-0489-48ae-b026-f1f6573feff4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:31.151059 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f257729d-0489-48ae-b026-f1f6573feff4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:31.448078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f257729d-0489-48ae-b026-f1f6573feff4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:31.498050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f257729d-0489-48ae-b026-f1f6573feff4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1215 microversion: 2.1 time: 0.354646 Aug 22 11:04:31.505211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 20/32] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:31 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:04:32.156410 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:04:32.156991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:04:32.157402 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:04:32.158118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:04:32.158587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:04:32.193796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:32.194739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:32.198380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:32.198380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:32.198380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:32.198380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:32.271975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:32.285343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for user 7c6fee0b956e41a7b2d9b914043633ea and project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:32.299978 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:04:32.309890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:04:32.528705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d86cf42a-b5a7-43a5-9caa-c7c7de991390 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:32.534137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d86cf42a-b5a7-43a5-9caa-c7c7de991390 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:32.593103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a3c55b39-2fb8-461f-9017-afb8cd6a8d10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.284360 Aug 22 11:04:32.597633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 13/33] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:04:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:04:32.610461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-230880b8-ccf6-4fcd-a8a9-1216016a6617 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:32.611684 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-230880b8-ccf6-4fcd-a8a9-1216016a6617 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:32.704586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d86cf42a-b5a7-43a5-9caa-c7c7de991390 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:32.715741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d86cf42a-b5a7-43a5-9caa-c7c7de991390 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1215 microversion: 2.1 time: 0.190499 Aug 22 11:04:32.718015 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 21/34] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:32 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:32.759917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-230880b8-ccf6-4fcd-a8a9-1216016a6617 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:32.769849 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-230880b8-ccf6-4fcd-a8a9-1216016a6617 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1222 microversion: 2.1 time: 0.168775 Aug 22 11:04:32.776455 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 14/35] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:32 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:33.741864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aed4959b-9342-432d-acaf-9db740df35f9 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:33.744861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aed4959b-9342-432d-acaf-9db740df35f9 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:33.799734 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-889a3594-9c53-4020-8c6a-628656f95926 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:33.800501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-889a3594-9c53-4020-8c6a-628656f95926 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:33.946808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aed4959b-9342-432d-acaf-9db740df35f9 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:33.954624 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aed4959b-9342-432d-acaf-9db740df35f9 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1215 microversion: 2.1 time: 0.217990 Aug 22 11:04:33.958910 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 22/36] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:33 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:34.232535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-889a3594-9c53-4020-8c6a-628656f95926 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:34.247830 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-889a3594-9c53-4020-8c6a-628656f95926 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1222 microversion: 2.1 time: 0.452594 Aug 22 11:04:34.249234 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 15/37] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:33 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1222 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:34.303285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1835279702", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1774e836-6324-4a7b-a06f-afa9bfeb3924"}], "security_groups": [{"name": "tempest-securitygroup--1969135618"}], "key_name": "tempest-keypair-906534526", "user_data": "}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:34.982293 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:34.983907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:34.998531 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:35.005005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] validate_networks() for [('1774e836-6324-4a7b-a06f-afa9bfeb3924', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:04:35.005944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:35.006740 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:35.009463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:35.010094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:35.010879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:35.711293 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:35.761248 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f326461d-7099-4fe0-92cb-eaae2f1a55b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1267 microversion: 2.1 time: 0.783538 Aug 22 11:04:35.768268 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 16/38] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:34 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1267 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:35.773172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:35.778179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:35.790881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:35.794159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:35.795072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:35.799062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:35.799732 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:35.801065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:36.217701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:36.231111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9057bddc-84f5-49b1-ac98-77b17d52c22d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1274 microversion: 2.1 time: 0.461592 Aug 22 11:04:36.231955 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 17/39] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:35 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1274 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:36.473408 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:04:36.473920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:04:36.474374 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:04:36.474997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:04:36.478774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:04:36.500770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:36.501557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:36.504895 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:36.507723 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:36.522875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:36.524834 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:36.581808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:36.595092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for user d13b7df898df4d238ea290fab8edc4a7 and project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:36.676465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:04:36.695562 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:04:36.793495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:36.794140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:36.822047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:36.822047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:36.822047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:36.829292 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:36.830179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:36.834908 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:36.970572 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68c6ac70-da06-45cc-ab33-a90955d4cac4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.672913 Aug 22 11:04:36.973433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 23/40] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 22 11:04:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 11:04:36.986957 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4bc2642d-eb23-4ab0-9c06-2eb6dd4e7381 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:36.991024 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4bc2642d-eb23-4ab0-9c06-2eb6dd4e7381 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:37.449860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:37.462948 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1de0f694-b7e2-4478-af21-53681a935f8c tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1273 microversion: 2.1 time: 0.677365 Aug 22 11:04:37.482509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 18/41] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:36 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1273 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:04:37.504751 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bc2642d-eb23-4ab0-9c06-2eb6dd4e7381 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:37.518585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:37.523754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:37.535625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bc2642d-eb23-4ab0-9c06-2eb6dd4e7381 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:37.537465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bc2642d-eb23-4ab0-9c06-2eb6dd4e7381 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:37.540900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4bc2642d-eb23-4ab0-9c06-2eb6dd4e7381 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1281 microversion: 2.20 time: 0.558268 Aug 22 11:04:37.547287 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 24/42] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:36 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1281 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:04:37.558047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:37.560660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:37.564400 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:37.565723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:37.567506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:37.568325 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:37.881323 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:37.894732 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1d7733fe-7148-450b-8384-d3531e622953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1280 microversion: 2.1 time: 0.408325 Aug 22 11:04:37.899802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 19/43] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:37 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:38.502662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:38.506808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:38.538961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:38.543610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:38.543610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:38.543610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:38.551690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:38.552339 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:38.579430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-19f368f9-9bd7-4ca0-a735-9446c9b2e791 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:38.580985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-19f368f9-9bd7-4ca0-a735-9446c9b2e791 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:38.882160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-19f368f9-9bd7-4ca0-a735-9446c9b2e791 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:38.890003 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-19f368f9-9bd7-4ca0-a735-9446c9b2e791 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:38.892163 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-19f368f9-9bd7-4ca0-a735-9446c9b2e791 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:38.894341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-19f368f9-9bd7-4ca0-a735-9446c9b2e791 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1281 microversion: 2.20 time: 0.320728 Aug 22 11:04:38.913629 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 20/44] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:38 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1281 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:38.941650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1950885809", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "166e6798-7b1d-482e-a524-1940d4c8d177"}], "security_groups": [{"name": "tempest-securitygroup--1471608542"}], "key_name": "tempest-keypair-1280105896", "user_data": "}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:39.163564 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:39.206649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0fde72af-afc2-449b-b264-a2eba2760313 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1273 microversion: 2.1 time: 0.712391 Aug 22 11:04:39.214141 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 25/45] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:38 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1273 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:39.219370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:39.236187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:39.268292 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:39.279149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:39.279692 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:39.280458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:39.280947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:39.281366 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:39.521472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] validate_networks() for [('166e6798-7b1d-482e-a524-1940d4c8d177', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:04:40.572799 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:40.629633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4bf02cf2-d138-4db9-89f7-09418b382042 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 1.407685 Aug 22 11:04:40.634490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 26/46] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:39 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:40.670710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:40.673507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:40.702417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:40.709028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:40.709861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:40.714779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:40.730481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:40.731800 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:41.117773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:41.134649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:41.138670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:41.146961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1b11a6f1-0f7c-4142-91aa-b472507e6126 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1333 microversion: 2.20 time: 0.512082 Aug 22 11:04:41.149783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 27/47] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:40 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1333 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:41.164047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:41.164047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:41.181629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:41.188024 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:41.189180 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:41.191408 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:41.194658 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:41.195226 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:42.224359 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:42.324434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:42.358036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-273fa70e-74a6-4c00-921c-7c11247dcf79 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 1.206672 Aug 22 11:04:42.358437 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 28/48] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:41 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:42.388549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:42.389780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:42.398932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:42.400184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:42.401358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:42.403338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:42.404261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:42.405002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.006294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:43.020094 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d3dca60b-8864-4907-89c8-4f6672217985 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.636815 Aug 22 11:04:43.020898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 29/49] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:42 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:43.038661 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:43.040827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:43.050754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:43.053397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:43.056700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.057721 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:43.058930 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:43.059768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.550494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:43.567235 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:43.590869 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:43.593850 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a7e27c0a-f8ab-458c-9ef5-0df192a51e8c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1339 microversion: 2.20 time: 0.571790 Aug 22 11:04:43.595756 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 30/50] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:43 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1339 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:43.613401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:43.614063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:43.633783 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:04:43.644023 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:04:43.647672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:04:43.649861 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:04:43.657993 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:43.659386 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:04:43.666722 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:43.667222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.667967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:43.668445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:43.669056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.689289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:43.709287 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:43.712427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.715576 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:43.719733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:43.722295 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:43.797048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:04:43.807746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:04:43.851822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:04:43.854494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:04:44.157882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a0ba0cea-c694-4871-aef0-2336dc719e04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.236925 Aug 22 11:04:44.159094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 21/51] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:04:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 5244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:04:44.182105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:44.183750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:44.224006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:44.240575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:44.241343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:44.244681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:44.247661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:44.249062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:44.801518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:44.813694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86547725-78f0-4fe9-862b-0e18ee93cf85 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 1.216600 Aug 22 11:04:44.814881 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 31/52] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:43 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:44.819766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3875f12a-5089-4faa-9b5e-0dc159ef1730 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:44.830221 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3875f12a-5089-4faa-9b5e-0dc159ef1730 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:44.957381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3875f12a-5089-4faa-9b5e-0dc159ef1730 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:44.972227 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3875f12a-5089-4faa-9b5e-0dc159ef1730 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1242 microversion: 2.1 time: 0.155232 Aug 22 11:04:44.976166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 32/53] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:44 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:44.993017 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:44.995037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:45.010335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:45.013144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:45.013144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:45.014718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:45.016870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:45.017735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:45.495655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:45.533567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:45.541533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:45.546650 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ffa3d1ce-bad9-4391-aafe-1e99be80a982 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1339 microversion: 2.20 time: 0.567746 Aug 22 11:04:45.556025 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 33/54] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:44 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:45.722919 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:45.741070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4d520d91-0430-425b-976b-16f707890ac5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 1.573472 Aug 22 11:04:45.743099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 22/55] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:44 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:45.837279 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:45.838561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:45.873591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:45.875934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:45.877134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:45.881429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:45.882897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:45.885613 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:46.467373 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819ff9d5-279f-46b0-977d-98240e33a48b", "tag": "8e13dc94-aa74-48ee-8120-ded9a1b2442f"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:46.500016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:46.500888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:46.502655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:46.550023 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:46.562186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Creating event network-changed:8e13dc94-aa74-48ee-8120-ded9a1b2442f for instance 819ff9d5-279f-46b0-977d-98240e33a48b on hv-cinder-85394 Aug 22 11:04:46.562966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121143) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 11:04:46.563533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6b85a5f4-1b8d-4028-8004-4d118879a6e6 req-f7b946cb-84d9-4e60-9d95-145bc500c4d4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121143) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 11:04:46.573181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:46.574124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:46.574801 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:46.575769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:46.578469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:46.579142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:46.613053 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.compute.rpcapi [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 11:04:46.616442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] Releasing lock "compute-rpcapi-router" {{(pid=121143) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 11:04:46.661748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-64093d7e-c7bc-4c66-9c0e-6665e44aed7c None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.671227 Aug 22 11:04:46.663388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 23/56] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:46.671103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:46.675240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:46.691186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:46.694081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:46.696632 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:46.697531 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:46.700630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:46.707994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:46.751375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:46.774981 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a08b840-3c4f-489f-8073-ed7b9818993a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.943066 Aug 22 11:04:46.776013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 34/57] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:45 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:47.267850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:47.291476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ee16a47a-c789-4048-a00a-051dfbffd8c3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1238 microversion: 2.1 time: 0.625106 Aug 22 11:04:47.292346 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 24/58] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:46 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1238 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:47.310572 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:47.310572 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:47.319250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.319655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.320130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.321048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.321463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.321893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.665018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da35ec84-c2f9-4fe2-a7cc-02d65039820f", "tag": "a543a772-d3af-4a83-89ee-7d50989cb6f8"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:47.701432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.702890 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.717069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.784456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:47.788524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Creating event network-changed:a543a772-d3af-4a83-89ee-7d50989cb6f8 for instance da35ec84-c2f9-4fe2-a7cc-02d65039820f on hv-cinder-85394 Aug 22 11:04:47.789309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 11:04:47.789878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efd7c74-2bb6-43a1-ab58-ae4cde5145dc req-4160278c-0355-4c8b-9a75-f938f90952bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=121142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 11:04:47.795294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.806202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:47.809143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.810467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:47.811799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-819121a1-0e03-47fc-81e4-02bb5687e143 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.518452 Aug 22 11:04:47.813170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.813871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 25/59] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:47 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:47.822920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.823988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.826516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.827051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:47.827985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:47.849544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.849544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.849544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.849544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.849934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.849934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.856471 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.compute.rpcapi [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 11:04:47.857596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] Releasing lock "compute-rpcapi-router" {{(pid=121142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 11:04:47.883399 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df6cd0bc-baf1-4316-a23e-8646b543b544 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.105596 Aug 22 11:04:47.884726 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 35/60] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:47.895597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:47.895597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:47.898910 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.899554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.900198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:47.901760 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:47.902621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:47.903299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:48.114035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:48.157377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b4950ab7-7427-4021-b366-d003b2bccb12 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.340728 Aug 22 11:04:48.174946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 26/61] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:47 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:48.317226 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:48.319081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:48.332683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:48.333232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:48.333621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:48.334352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:48.334808 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:48.335475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:48.443328 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:48.451846 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3a60363d-65da-4228-b080-3e9e1a07cc19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1302 microversion: 2.1 time: 0.139574 Aug 22 11:04:48.467065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 27/62] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:48 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:48.520807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:48.543233 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dbad9034-6e17-4a66-93a7-04a110c1d760 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.656601 Aug 22 11:04:48.547014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 36/63] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:47 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:48.840412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:48.841329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:48.857541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:48.876591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:48.878311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:48.880085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:48.880916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:48.881841 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:48.884884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:49.112551 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-351797da-fe4f-43af-8351-fa679c9285f8 req-92bbad08-c624-407d-9c60-cb60a89dbd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0", "tag": "5aa72877-eecc-4955-806c-48e0a9b360a8"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:49.149918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-351797da-fe4f-43af-8351-fa679c9285f8 req-92bbad08-c624-407d-9c60-cb60a89dbd98 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:49.152868 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-351797da-fe4f-43af-8351-fa679c9285f8 req-92bbad08-c624-407d-9c60-cb60a89dbd98 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:49.156041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-351797da-fe4f-43af-8351-fa679c9285f8 req-92bbad08-c624-407d-9c60-cb60a89dbd98 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:49.213413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-351797da-fe4f-43af-8351-fa679c9285f8 req-92bbad08-c624-407d-9c60-cb60a89dbd98 service nova] Creating event network-changed:5aa72877-eecc-4955-806c-48e0a9b360a8 for instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 on hv-cinder-85394 Aug 22 11:04:49.243874 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-351797da-fe4f-43af-8351-fa679c9285f8 req-92bbad08-c624-407d-9c60-cb60a89dbd98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144480 Aug 22 11:04:49.246365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 37/64] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:04:49.280842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:49.305207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:49.316250 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:49.317791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:49.318316 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:49.319166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:49.322415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:49.324095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:49.719528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:49.731567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:49.737988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:49.743082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-07b16f1d-0955-4c6e-8ec6-6903e3b27144 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.906953 Aug 22 11:04:49.743667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 28/65] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:48 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:49.762441 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:49.763694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:49.782716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:49.783222 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:49.783661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:49.793161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:49.794001 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:49.794752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:50.144055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:50.146072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:50.159260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-eddf3754-6593-4976-9444-e5dc8f0014a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1300 microversion: 2.1 time: 0.407881 Aug 22 11:04:50.159260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 29/66] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:49 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1300 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:50.161190 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-21fdacd7-d8a5-4bb2-8ac2-fce0a8563a87 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.914531 Aug 22 11:04:50.179224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 38/67] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:49 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:50.206749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:50.208438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:50.249783 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:50.258363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:50.261217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:50.262489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:50.270657 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:50.275806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:50.767742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:50.768664 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:50.777776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:50.791083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:50.791866 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:50.792848 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:50.793517 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:50.794128 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:51.025885 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:51.048059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b9ac5639-05da-4c51-bafc-94b28c82d62e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.859742 Aug 22 11:04:51.053221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 30/68] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:50 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:51.180676 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:51.181638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:51.193921 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:51.197669 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:51.198259 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:51.199127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:51.201425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:51.205978 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:51.518873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:51.534903 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-49f71fb4-b8d4-47e7-ab6d-e2305e53d5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1300 microversion: 2.1 time: 0.357543 Aug 22 11:04:51.544032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 31/69] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:51 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:51.558107 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:51.560995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:51.585403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:51.586844 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:51.588885 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:51.590961 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:51.600111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:51.601982 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:51.610915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:51.627206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:51.628701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:51.629808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-564e55fb-29a8-4b17-884e-2641d2255d64 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.867240 Aug 22 11:04:51.637776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 39/70] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:50 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:51.655154 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-e3eecf45-08d6-48d8-970b-8f3acf8bd19c req-786f3a7e-d8bf-4c7e-a0f9-d38e7351984a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:51.671703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-e3eecf45-08d6-48d8-970b-8f3acf8bd19c req-786f3a7e-d8bf-4c7e-a0f9-d38e7351984a service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:51.673793 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-e3eecf45-08d6-48d8-970b-8f3acf8bd19c req-786f3a7e-d8bf-4c7e-a0f9-d38e7351984a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:51.675581 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-e3eecf45-08d6-48d8-970b-8f3acf8bd19c req-786f3a7e-d8bf-4c7e-a0f9-d38e7351984a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:51.700752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-e3eecf45-08d6-48d8-970b-8f3acf8bd19c req-786f3a7e-d8bf-4c7e-a0f9-d38e7351984a service nova] Creating event network-changed:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:04:51.719026 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-e3eecf45-08d6-48d8-970b-8f3acf8bd19c req-786f3a7e-d8bf-4c7e-a0f9-d38e7351984a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079719 Aug 22 11:04:51.737544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 40/71] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:04:52.007796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:52.016519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5f903244-fee8-424f-947e-4c32b219cb90 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.471092 Aug 22 11:04:52.018547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 32/72] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:51 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:52.081696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:52.082603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:52.087370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:52.100879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:52.102180 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:52.103165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:52.104618 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:52.105758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:52.106436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:52.135013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=85 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:52.308784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:52.336752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6b5ac7ec-544f-4fa3-a23c-8900da386112 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.259172 Aug 22 11:04:52.344950 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 41/73] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:52 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:52.562110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:52.562793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:52.568541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:52.569016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:52.569513 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:52.570224 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:52.570664 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:52.571079 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:52.573522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=95 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:52.660153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:52.660765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:52.668475 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:52.668961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:52.669398 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:52.670206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:52.670726 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:52.671150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:52.773575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:52.782581 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7f5294ea-cb12-4707-b8e7-043e0ad4645b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.224281 Aug 22 11:04:52.783713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 33/74] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:52 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:52.897169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:52.906747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:52.908130 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:52.910021 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4b5aaea7-359c-41b0-9f23-c436385d9734 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.254793 Aug 22 11:04:52.910754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 42/75] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:52 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:53.040005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:53.040005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:53.045664 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.046275 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.046799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.047570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.048087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.048700 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.195202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:53.203150 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1940187b-92a2-4ed2-9ba0-9604ce24a188 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.170295 Aug 22 11:04:53.203727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 34/76] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:53 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:53.365361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:53.365985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:53.377022 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.377516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.377994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.378755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.379348 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.379781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.525390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:53.536257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f55c4446-02d1-4683-99a7-5985072cb5b7 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.172817 Aug 22 11:04:53.536257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 43/77] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:53 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:53.805534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:53.806949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:53.814081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.815564 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.816252 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.817767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.819144 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.820514 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.854473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=30 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:53.934156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:53.934835 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:53.956626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.957473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.958042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.958854 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:53.959391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:53.959915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:53.997333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:54.005690 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4d7ac05e-5f67-4a7c-a3f8-88a855112ef7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.204367 Aug 22 11:04:54.006286 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 35/78] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:53 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:54.127871 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:54.136778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:54.138346 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:54.139452 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c88a1333-71cc-45e0-802f-daba8003fbb3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.210433 Aug 22 11:04:54.140001 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 44/79] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:53 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:04:54.223852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:54.224708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:54.231015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:54.231723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:54.232143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:54.232999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:54.233596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:54.234167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:54.380857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:54.389529 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d287241b-93c3-4941-980d-6f422ba5aab9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.169509 Aug 22 11:04:54.390118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 36/80] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:54 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:54.556789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:54.557370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:54.563987 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:54.564541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:54.565066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:54.566097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:54.566733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:54.567308 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:54.717193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:54.725273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff3c8a0e-561f-4c34-9dab-1d049a35415a tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.174048 Aug 22 11:04:54.726395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 45/81] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:54 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:55.032998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:55.034191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:55.040269 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.083913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.083913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.083913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.083913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.084338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.168186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:55.168798 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:55.171655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=26 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:55.175488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.176028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.176481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.177334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.177782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.178204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.190486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:55.201693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-155ebc7c-6e24-45c4-9c12-b74bdd906ed1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.172940 Aug 22 11:04:55.216384 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 37/82] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:55 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:55.409188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:55.409718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:55.416634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.417117 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.417548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.418411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.418861 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.419279 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.565577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:55.574353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3ad96a99-8b70-4755-8de1-3d7baa1456b8 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.169021 Aug 22 11:04:55.575562 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 38/83] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:55 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:04:55.598622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:55.607389 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:55.608885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:55.610264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-507f8fdc-e750-4f57-bfd8-ec506e8bf026 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.445885 Aug 22 11:04:55.610820 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 46/84] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:55 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:55.746872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:55.747423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:55.753776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.754222 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.754574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.755569 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:55.756125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:55.756440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:55.912564 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:55.927490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5f85f90a-ebb9-4bd8-bd8c-a970d0e50f0e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.184823 Aug 22 11:04:55.942026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 39/85] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:55 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:56.165630 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-7c1be658-9034-4104-a76c-e085fd9a85ea req-d0ff9ab8-ffd3-4ddb-8fbc-c3ac4cd1a107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff96ff0-c3fa-48a3-8483-065985f353b2", "tag": "de7412eb-f311-4316-8363-cb7f23a43ba7"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:04:56.178159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7c1be658-9034-4104-a76c-e085fd9a85ea req-d0ff9ab8-ffd3-4ddb-8fbc-c3ac4cd1a107 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.179485 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7c1be658-9034-4104-a76c-e085fd9a85ea req-d0ff9ab8-ffd3-4ddb-8fbc-c3ac4cd1a107 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.180269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7c1be658-9034-4104-a76c-e085fd9a85ea req-d0ff9ab8-ffd3-4ddb-8fbc-c3ac4cd1a107 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.192828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-7c1be658-9034-4104-a76c-e085fd9a85ea req-d0ff9ab8-ffd3-4ddb-8fbc-c3ac4cd1a107 service nova] Creating event network-changed:de7412eb-f311-4316-8363-cb7f23a43ba7 for instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 on hv-cinder-85394 Aug 22 11:04:56.198492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-7c1be658-9034-4104-a76c-e085fd9a85ea req-d0ff9ab8-ffd3-4ddb-8fbc-c3ac4cd1a107 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037321 Aug 22 11:04:56.199319 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 47/86] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:04:56.230655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:56.231275 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:56.243924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.244421 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.244855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.245987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.245987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.252990 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.396837 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:56.406015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d3caabc5-1c3e-40ec-bc8b-8497f68dec75 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.186041 Aug 22 11:04:56.406788 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 40/87] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:56 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:56.598847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:56.599539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:56.606437 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.606920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.607352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.608233 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.609251 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.609701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.632895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:56.633749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:56.635750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:56.648185 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.648874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.649333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.650217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.650690 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.651110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.769382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:56.779254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-49e3e4f0-43d4-4bd7-b4f0-b116c5236377 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.184358 Aug 22 11:04:56.780277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 48/88] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:56 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:56.855610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:56.866941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:56.868458 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:56.870337 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8a0a6b3d-5968-4aaf-99c3-8e9478278f7b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.241283 Aug 22 11:04:56.870697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 41/89] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:56 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:56.949789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:56.950392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:56.962481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.962481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.962481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:56.962481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:56.962838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:56.962838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:57.142507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:57.150875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-91937da4-81ee-4ad7-8edc-bed36a5dd252 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.205635 Aug 22 11:04:57.151443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 49/90] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:56 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:57.426928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:57.427634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:57.433829 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:57.434327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:57.434758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:57.435448 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:57.435892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:57.436309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:57.572446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:57.580067 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-64062e48-15ae-4899-bd76-df95cb6aaf0c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.157408 Aug 22 11:04:57.580892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 42/91] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:57 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:57.801930 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:57.802767 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:57.808603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:57.809077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:57.809508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:57.810191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:57.810663 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:57.811082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:57.849979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:04:57.907066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:57.908712 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:57.916145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:57.921809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:57.921809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:57.921809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:57.921809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:57.922519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:58.050651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:58.060189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cdde5c59-1016-4674-a472-350f0b5e9abe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.262853 Aug 22 11:04:58.066957 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 50/92] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:57 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:58.135640 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:58.144551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:58.146296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:58.147351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c720851e-ed35-4ecb-b39a-183dd8c16091 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.255509 Aug 22 11:04:58.154381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 43/93] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:57 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:58.172170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:58.172833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:58.180119 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:58.181121 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:58.181617 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:58.182344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:58.182846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:58.183268 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:58.321925 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:58.330701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4845f48d-f2ad-4aaa-9ba4-1c4968aa5442 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.162288 Aug 22 11:04:58.331290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 51/94] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:58 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:58.600893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:58.601515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:58.608099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:58.608632 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:58.609066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:58.610012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:58.610503 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:58.610934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:58.831962 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:58.841860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-327b84a2-e491-4070-a10b-57552caa8f79 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.244743 Aug 22 11:04:58.854662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 44/95] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:58 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:59.088192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:59.088834 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:59.102472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.103249 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.105372 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.106431 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.108095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.110761 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.180650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:59.180650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:59.190026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.191479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.193003 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.193765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.194267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.194698 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.377286 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:59.385620 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fb2e046e-cc2b-4dc8-b1f5-c9c773d1e28f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.302609 Aug 22 11:04:59.386842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 52/96] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:59 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:59.398075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:59.399553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:59.420568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.423451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.425218 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.426162 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.427856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.430741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.513575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:59.522943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:59.527242 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:59.527880 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1537ec1b-9129-4921-ba08-d52008b6ca0b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.358726 Aug 22 11:04:59.539527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 45/97] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:04:59 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:04:59.687121 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:04:59.698507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7bea19d4-0dd6-483f-841b-6fa664f0843f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.310290 Aug 22 11:04:59.699764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 53/98] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:59 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:04:59.874102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:04:59.877800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:04:59.882332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.883750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.884467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:04:59.885347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:04:59.885950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:04:59.886556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.047435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:00.054452 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4c42740c-8d0e-45cb-96c0-36cf520bddb5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.195482 Aug 22 11:05:00.068369 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 46/99] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:04:59 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:00.407734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:00.409074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:00.422330 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.423001 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.423847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.425091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.425706 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.426507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.572114 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-7cde96d8-0645-4e60-b1ae-c07baef0ba42 req-cb6ae121-41f8-4085-b136-fb83cf8b621d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ff9d5-279f-46b0-977d-98240e33a48b", "name": "network-vif-plugged", "status": "completed", "tag": "8e13dc94-aa74-48ee-8120-ded9a1b2442f"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:00.584522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7cde96d8-0645-4e60-b1ae-c07baef0ba42 req-cb6ae121-41f8-4085-b136-fb83cf8b621d service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.585519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7cde96d8-0645-4e60-b1ae-c07baef0ba42 req-cb6ae121-41f8-4085-b136-fb83cf8b621d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.586253 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7cde96d8-0645-4e60-b1ae-c07baef0ba42 req-cb6ae121-41f8-4085-b136-fb83cf8b621d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.624502 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-7cde96d8-0645-4e60-b1ae-c07baef0ba42 req-cb6ae121-41f8-4085-b136-fb83cf8b621d service nova] Creating event network-vif-plugged:8e13dc94-aa74-48ee-8120-ded9a1b2442f for instance 819ff9d5-279f-46b0-977d-98240e33a48b on hv-cinder-85394 Aug 22 11:05:00.634022 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-7cde96d8-0645-4e60-b1ae-c07baef0ba42 req-cb6ae121-41f8-4085-b136-fb83cf8b621d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227332 Aug 22 11:05:00.635428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 47/100] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:05:00.642439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:00.647392 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:00.648281 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:00.660044 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.660613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.661313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.661746 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-67358d18-63e6-4ec2-98b3-b77b37dafe3d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.253835 Aug 22 11:05:00.662031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.662730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.663188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.669153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 54/101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:00 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:00.728191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:00.728802 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:00.735659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.736191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.736582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.738508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:00.739433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:00.740123 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:00.872285 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:00.883100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:00.890307 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:00.891720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a07b772f-a230-4791-a988-094624393343 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.251630 Aug 22 11:05:00.892761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 48/102] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:00 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:05:00.931245 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:00.940244 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d9bd82fc-befd-4b47-8177-90996845408f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.217877 Aug 22 11:05:00.940747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 55/103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:00 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:01.076590 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:01.077283 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:01.083075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.083567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.084006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.084708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.085342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.085773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.330514 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:01.342770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-37000a1a-ba2c-418a-8f12-6e55326889c0 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.269765 Aug 22 11:05:01.357730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 49/104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:01 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:01.689153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:01.689847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:01.699342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.699342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.699342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.699342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.700105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.700105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.895048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:01.915741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e91a51fd-1b43-4da4-bd9d-2c7f2fafe4a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.227134 Aug 22 11:05:01.917009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 56/105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:01 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:01.928103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:01.932560 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:01.949596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.950858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.955762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.955762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.955762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.955762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.961809 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:01.962936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:01.970041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.971108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.971696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.972554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:01.973168 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:01.973771 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:01.977518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:02.122326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:02.131992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:02.134864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:02.136461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d1ce8634-bee2-4f4a-87be-849863580bf3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.224126 Aug 22 11:05:02.137470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 50/106] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:01 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:05:02.186444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:02.195090 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58d77815-223c-4c03-aedb-0ec42d9a9edf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.237669 Aug 22 11:05:02.206682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 57/107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:01 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:02.368899 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:02.370543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:02.382338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:02.383953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:02.384638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:02.396786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:02.397962 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:02.401836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:02.576191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:02.586696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-690f6baa-c8d3-47b9-9c6f-28d425e50de7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.223109 Aug 22 11:05:02.587667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 51/108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:02 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:02.684203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-6af0f56f-9b43-4d3b-adae-db94a74d3b1f req-5834d3ea-dcdb-4ea2-9e6a-1732c3129ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0", "name": "network-vif-plugged", "status": "completed", "tag": "5aa72877-eecc-4955-806c-48e0a9b360a8"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:02.705005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6af0f56f-9b43-4d3b-adae-db94a74d3b1f req-5834d3ea-dcdb-4ea2-9e6a-1732c3129ec3 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:02.705911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6af0f56f-9b43-4d3b-adae-db94a74d3b1f req-5834d3ea-dcdb-4ea2-9e6a-1732c3129ec3 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:02.706213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6af0f56f-9b43-4d3b-adae-db94a74d3b1f req-5834d3ea-dcdb-4ea2-9e6a-1732c3129ec3 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:02.721075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-6af0f56f-9b43-4d3b-adae-db94a74d3b1f req-5834d3ea-dcdb-4ea2-9e6a-1732c3129ec3 service nova] Creating event network-vif-plugged:5aa72877-eecc-4955-806c-48e0a9b360a8 for instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 on hv-cinder-85394 Aug 22 11:05:02.730817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-6af0f56f-9b43-4d3b-adae-db94a74d3b1f req-5834d3ea-dcdb-4ea2-9e6a-1732c3129ec3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050318 Aug 22 11:05:02.739810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 58/109] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:05:02.939194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:02.939862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:02.946708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:02.947188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:02.947795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:02.948495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:02.948939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:02.949357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.135838 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:03.145177 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a1ff0675-b8f0-48a7-95ea-8c5abe0f8b17 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.209718 Aug 22 11:05:03.147454 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 52/110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:02 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:03.162053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:03.162885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:03.172491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:03.172491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:03.172491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.172491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:03.172879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:03.173494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.179104 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:03.221677 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:03.224338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:03.230463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:03.230960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:03.231419 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.232119 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:03.232566 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:03.232988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.393527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:03.403310 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:03.420595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-da800fa7-7741-4946-b6cc-8c2354129ebf tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.203007 Aug 22 11:05:03.421209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:03.424894 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 53/111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:03 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:03.425725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:03.427914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-359f7984-9fae-4601-8165-98957382179c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.270051 Aug 22 11:05:03.428809 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 59/112] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:03 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:05:03.608925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:03.610142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:03.617105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:03.617820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:03.618486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.619422 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:03.620083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:03.620592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:03.779193 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:03.787441 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9da004f4-5b4d-4288-af0d-3d29778510d7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.182329 Aug 22 11:05:03.799847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 54/113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:03 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:04.170647 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:04.171260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:04.177685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.178082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.183334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.184095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.184568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.185099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.372563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:04.380964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f60af4a1-7e58-4774-a32f-e47a097bd48d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1322 microversion: 2.1 time: 0.214578 Aug 22 11:05:04.395772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 60/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:04 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:04.444718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:04.445977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:04.452330 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.452823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.453247 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.454147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.460820 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:04.461844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:04.465312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.468101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.471587 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.472231 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.474507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.475484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.479045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.479577 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.657417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:04.667253 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-524f2ecf-9a59-4327-98b5-11cbaca8c8a8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.226410 Aug 22 11:05:04.668370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 55/115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:04 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:04.694120 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:04.704619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:04.707352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:04.710104 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-090a76f2-4f2f-4c18-8048-50c663ca4918 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.252341 Aug 22 11:05:04.711409 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 61/116] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:04 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:05:04.761615 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da35ec84-c2f9-4fe2-a7cc-02d65039820f", "name": "network-vif-plugged", "status": "completed", "tag": "a543a772-d3af-4a83-89ee-7d50989cb6f8"}, {"server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "name": "network-vif-plugged", "status": "completed", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:04.775421 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.775961 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.776332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.801322 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] Creating event network-vif-plugged:a543a772-d3af-4a83-89ee-7d50989cb6f8 for instance da35ec84-c2f9-4fe2-a7cc-02d65039820f on hv-cinder-85394 Aug 22 11:05:04.801831 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] Creating event network-vif-plugged:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:05:04.812586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:04.813666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:04.819533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-73a81ee7-151b-49d1-b02e-ba7738209c01 req-aac34819-f834-4ac9-bfa5-7e51b8f08de5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067039 Aug 22 11:05:04.820773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 56/117] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:05:04.822615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.823279 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.823713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.824407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:04.825111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:04.825727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:04.989912 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:04.997304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bf69300a-8be8-41be-8a89-a78170fd0194 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.193268 Aug 22 11:05:04.997885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 62/118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:04 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:05.405324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:05.406179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:05.412772 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.413434 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.414156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.415081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.416168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.416168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.689256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:05.689861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:05.696476 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.696962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.697393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.699195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.699413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.699856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.852258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:05.861614 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9e8effcb-b2fc-403f-9877-2393646ed5e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1517 microversion: 2.1 time: 0.461172 Aug 22 11:05:05.870878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 57/119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:05 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:05.879416 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:05.880087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:05.888261 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.888770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.889166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.889901 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.890394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.890951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.931540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:05.939399 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3f187f89-9abd-4741-9944-778f0e23a22e tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.254162 Aug 22 11:05:05.940031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 63/120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:05 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:05.946405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:05.954019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:05.964568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.965309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.968058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:05.968816 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:05.969281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:05.969714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.050798 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lazy-loading 'flavor' on Instance uuid a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:05:06.096566 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:06.106256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:06.107857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:06.108976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-16d2c608-394a-4562-a0a4-b25392474f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1407 microversion: 2.20 time: 0.236758 Aug 22 11:05:06.110373 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 58/121] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:05 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:05:06.117751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:06.119406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:06.126458 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.127248 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.127839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.128750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.129589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.130016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.311356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:06.326033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cb906318-fae9-4107-98f8-918bb907b8d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.214321 Aug 22 11:05:06.328225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 59/122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:06 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:06.391972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2481f428-8ef7-45c2-9104-2dc1920adc94 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0/action" status: 200 len: 32 microversion: 2.1 time: 0.450241 Aug 22 11:05:06.393270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 64/123] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:05:05 2022] POST /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0/action => generated 32 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:05:06.405556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:06.406412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:06.414652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.415448 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.416135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.416902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.417417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.418058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.618598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:06.626991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ba5d0927-7907-422f-8f5b-864558c12c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.225801 Aug 22 11:05:06.630583 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 60/124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:06 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:06.845123 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-7162983d-000f-4d38-85d7-e42631cb5bb1 req-10b9d9a3-7032-4e1f-b2ef-82509e6a60c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff96ff0-c3fa-48a3-8483-065985f353b2", "name": "network-vif-plugged", "status": "completed", "tag": "de7412eb-f311-4316-8363-cb7f23a43ba7"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:06.864667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7162983d-000f-4d38-85d7-e42631cb5bb1 req-10b9d9a3-7032-4e1f-b2ef-82509e6a60c0 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.865480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7162983d-000f-4d38-85d7-e42631cb5bb1 req-10b9d9a3-7032-4e1f-b2ef-82509e6a60c0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.866121 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7162983d-000f-4d38-85d7-e42631cb5bb1 req-10b9d9a3-7032-4e1f-b2ef-82509e6a60c0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.882900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-7162983d-000f-4d38-85d7-e42631cb5bb1 req-10b9d9a3-7032-4e1f-b2ef-82509e6a60c0 service nova] Creating event network-vif-plugged:de7412eb-f311-4316-8363-cb7f23a43ba7 for instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 on hv-cinder-85394 Aug 22 11:05:06.889111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-7162983d-000f-4d38-85d7-e42631cb5bb1 req-10b9d9a3-7032-4e1f-b2ef-82509e6a60c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049745 Aug 22 11:05:06.890006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 65/125] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:06.963020 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:06.963644 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:06.970946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.971642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.972238 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:06.972950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:06.973569 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:06.974023 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.136014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:07.136731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:07.142898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.143380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.143823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.144493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.145134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.145561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.157554 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:07.171464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-175d372c-f355-4718-b39f-323175a3b567 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1315 microversion: 2.1 time: 0.213145 Aug 22 11:05:07.172083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 61/126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:06 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:07.356767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:07.358673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:07.370683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.371342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.374451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.374451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.374451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.375110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.388934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:07.401469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:07.408520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:07.416100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-65a82af9-8aa3-4305-afdb-d11e23d62cef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1599 microversion: 2.20 time: 0.281356 Aug 22 11:05:07.418573 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 66/127] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:07 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1599 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:05:07.443344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:07.444090 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:07.455226 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.456366 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.457253 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.458137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.458928 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.464766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.545519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f68c99cc-b417-4df6-b040-169a9b6cd5ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106006 Aug 22 11:05:07.556538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 67/128] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 22 11:05:07 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 11:05:07.616294 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:07.638045 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8fd33821-8ebc-4c1a-baa7-53f466f3195f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.281688 Aug 22 11:05:07.640289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 62/129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:07 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:07.648275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:07.648911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:07.663990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.664483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.664919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:07.665621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:07.666066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:07.666510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:08.056481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:08.065952 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-709f67cb-bec1-41d0-9c30-c93b5ec5180f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.420259 Aug 22 11:05:08.067495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 68/130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:07 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:08.192363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:08.192966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:08.199935 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:08.200622 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:08.201219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:08.202218 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:08.202850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:08.203574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:08.511943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:08.521054 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5f5ffb3c-1063-47bd-8f58-acba6a8598b3 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1502 microversion: 2.1 time: 0.332401 Aug 22 11:05:08.522211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 63/131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:08 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1502 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:08.652082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:08.652699 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:08.662404 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:08.663169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:08.665349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:08.666355 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:08.667080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:08.667674 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:08.846007 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:08.865111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-381412b1-07f6-4f38-84b5-eb6b97d143be tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.216104 Aug 22 11:05:08.867753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 69/132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:08 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:09.089367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:09.090191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:09.098016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:09.098699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:09.099140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:09.100231 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:09.101134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:09.101927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:09.268769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-65bdb2ac-985d-4ba0-adfd-59cd17c6abff req-594e51c5-c7c1-4f51-b8c3-2278a5938298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:09.286859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-65bdb2ac-985d-4ba0-adfd-59cd17c6abff req-594e51c5-c7c1-4f51-b8c3-2278a5938298 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:09.288750 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-65bdb2ac-985d-4ba0-adfd-59cd17c6abff req-594e51c5-c7c1-4f51-b8c3-2278a5938298 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:09.289198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-65bdb2ac-985d-4ba0-adfd-59cd17c6abff req-594e51c5-c7c1-4f51-b8c3-2278a5938298 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:09.307937 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-65bdb2ac-985d-4ba0-adfd-59cd17c6abff req-594e51c5-c7c1-4f51-b8c3-2278a5938298 service nova] Creating event network-changed:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:05:09.313123 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-65bdb2ac-985d-4ba0-adfd-59cd17c6abff req-594e51c5-c7c1-4f51-b8c3-2278a5938298 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047785 Aug 22 11:05:09.316846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 70/133] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:09.339985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:09.355046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-42ae29d8-e89c-40a4-b325-b6fc87e93330 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.270814 Aug 22 11:05:09.356078 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 64/134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:09 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:09.892129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:09.893069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:09.907626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:09.911138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:09.911943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:09.912892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:09.914176 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:09.915999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:10.377133 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:10.377739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:10.389243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:10.389811 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:10.390278 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:10.391493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:10.391942 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:10.392363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:10.654136 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:10.668166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-25b5b1b2-1292-4ea5-b44c-a5107cd98088 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1368 microversion: 2.1 time: 0.781037 Aug 22 11:05:10.668754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 71/135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:09 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1368 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:10.685183 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b57cebd7-115e-4155-a7c3-0957c5116a59"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:10.688592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:10.702707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:10.712525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3c62d727-e5cd-4989-9535-b617dad6e4fb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.339199 Aug 22 11:05:10.713655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 65/136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:10 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:10.723815 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:10.724297 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:10.724726 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:10.725423 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:10.725919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:10.727827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:11.692822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:11.693762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:11.707790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:11.708299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:11.708748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:11.709460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:11.709916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:11.710608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:11.870201 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:11.877857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-74a0e0cd-e1af-4cec-a8a5-542e4bff7abe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1557 microversion: 2.1 time: 0.188845 Aug 22 11:05:11.891048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 66/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:11 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:11.891048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:11.891048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:11.891048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:11.891360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:11.891360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:11.891971 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:11.892416 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:11.892834 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:12.047811 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:12.050500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:12.057518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-741105de-da0b-4266-88cc-d3dd34da8e80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.177702 Aug 22 11:05:12.058340 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 67/138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:11 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:12.072979 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:12.073480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:12.080646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:12.081407 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:12.081840 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:12.082566 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:12.083163 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:12.083580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:12.168838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-92c0edf1-8f09-4bbd-a6e7-41b9e0221005 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "POST /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.498647 Aug 22 11:05:12.169449 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 72/139] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:05:10 2022] POST /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f/os-volume_attachments => generated 194 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:12.224205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a274f3f7-4b19-43de-905c-5cb8aa6861f9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164689 Aug 22 11:05:12.226493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 68/140] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:05:12 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:13.079107 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:13.080200 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:13.087510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:13.088321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:13.089002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:13.089886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:13.090590 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:13.091217 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:13.320415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:13.330837 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-371f2dc6-b547-4a22-ab8c-cbed5e6dcebc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.255917 Aug 22 11:05:13.347947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 73/141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:13 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:13.563093 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-35c5fafb-1528-4d71-b4d6-a8b6354d55ef req-9f8fec06-1663-4286-81ed-a19f140a5acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff96ff0-c3fa-48a3-8483-065985f353b2", "tag": "de7412eb-f311-4316-8363-cb7f23a43ba7"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:13.578097 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-35c5fafb-1528-4d71-b4d6-a8b6354d55ef req-9f8fec06-1663-4286-81ed-a19f140a5acf service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:13.578580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-35c5fafb-1528-4d71-b4d6-a8b6354d55ef req-9f8fec06-1663-4286-81ed-a19f140a5acf service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:13.579378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-35c5fafb-1528-4d71-b4d6-a8b6354d55ef req-9f8fec06-1663-4286-81ed-a19f140a5acf service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:13.592540 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-35c5fafb-1528-4d71-b4d6-a8b6354d55ef req-9f8fec06-1663-4286-81ed-a19f140a5acf service nova] Creating event network-changed:de7412eb-f311-4316-8363-cb7f23a43ba7 for instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 on hv-cinder-85394 Aug 22 11:05:13.598105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-35c5fafb-1528-4d71-b4d6-a8b6354d55ef req-9f8fec06-1663-4286-81ed-a19f140a5acf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045321 Aug 22 11:05:13.598993 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 69/142] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:14.353935 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:14.354720 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:14.372280 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:14.375102 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:14.375731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:14.378586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:14.379191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:14.379775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:14.426900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:14.567491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:14.577204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-31753d26-e8d0-4060-9ba1-a043728fdbeb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.227928 Aug 22 11:05:14.577807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 74/143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:14 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:15.606015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:15.606765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:15.613400 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:15.613882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:15.614395 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:15.615069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:15.615516 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:15.615937 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:15.791871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:15.804449 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e0818248-881f-4056-b46f-e5395fca318f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.209864 Aug 22 11:05:15.805028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 70/144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:15 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:16.824741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:16.825418 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:16.832434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:16.832908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:16.833338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:16.834052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:16.834523 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:16.834940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:16.982687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:16.998256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-78a32b0f-5420-4c10-820c-4d163e06ea26 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.177186 Aug 22 11:05:16.999023 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 75/145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:16 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:18.019959 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:18.020731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:18.027464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:18.028087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:18.028643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:18.029456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:18.030008 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:18.030555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:18.182693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:18.190255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3859a7c3-39f6-4dfa-a414-058920b1d11c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.174357 Aug 22 11:05:18.192240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 71/146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:18 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:19.210654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:19.212095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:19.219344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:19.219829 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:19.220265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:19.220955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:19.221408 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:19.221828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:19.351135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:19.359750 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-92983b8a-67d5-4187-9a0a-4a000f5e46e9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.152569 Aug 22 11:05:19.360308 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 76/147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:19 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:20.381419 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:20.382102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:20.384553 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=87 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:20.389315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:20.389952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:20.390183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:20.391111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:20.391480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:20.392035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:20.534036 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:20.542366 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4a67846a-eb0d-4317-9c32-249bc3c6e55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.165393 Aug 22 11:05:20.554614 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 72/148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:20 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:21.565255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:21.565994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:21.573409 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:21.573979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:21.575688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:21.575688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:21.575688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:21.576361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:21.786484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:21.794781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54116416-6713-4ad5-a535-ed4f36e5f97c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.233671 Aug 22 11:05:21.796004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 77/149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:21 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:22.816604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:22.817558 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:22.830634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:22.831345 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:22.831786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:22.832504 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:22.832952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:22.833368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:22.975002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:22.983810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-577d7ff1-70a1-4b99-88d9-4796a09c347a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.171396 Aug 22 11:05:22.984653 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 73/150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:22 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:23.527227 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:23.528552 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:23.534631 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=74 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:23.540387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:23.541216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:23.541858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:23.543336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:23.544013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:23.544636 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:23.575870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:05:23.896633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d8b6fdf0-c916-4b57-87f2-708131709179 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 204 len: 0 microversion: 2.1 time: 0.374865 Aug 22 11:05:23.897795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 78/151] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:05:23 2022] DELETE /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:05:23.905865 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:23.907165 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:23.913841 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:23.915016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:23.915449 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:23.916143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:23.916720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:23.917326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:24.009605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:24.010502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:24.020612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:24.021470 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:24.021909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:24.023068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:24.024271 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:24.024793 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:24.097495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:24.108756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a875140d-f2e2-41ad-a842-14c23fa5d7c4 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1554 microversion: 2.1 time: 0.206632 Aug 22 11:05:24.109609 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 74/152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:23 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:24.183282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:24.191056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3eae565c-ecf6-44bc-a3d1-67b9948b62ee tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.188208 Aug 22 11:05:24.191624 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 79/153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:24 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:25.129225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:25.129838 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:25.136367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:25.136855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:25.137290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:25.137981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:25.138507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:25.138927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:25.214777 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:25.216380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:25.225089 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:25.225776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:25.226215 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:25.227612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:25.228106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:25.228521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:25.287396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:25.297724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6635a721-02d8-4f80-827f-44a4d76c6ce2 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1554 microversion: 2.1 time: 0.172313 Aug 22 11:05:25.298858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 75/154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:25 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:25.387856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:25.405310 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7b8b1194-f7b6-4fea-ae6c-a17b3a993ea7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.188088 Aug 22 11:05:25.405310 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 80/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:25 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:26.326596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:26.326596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:26.329611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:26.330092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:26.330551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:26.331312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:26.331678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:26.332159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:26.417817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:26.418626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:26.425683 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:26.426173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:26.426833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:26.427710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:26.428169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:26.428624 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:26.474106 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:26.482926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-40e9692d-2940-4ff2-bc53-9c05ebbca60b tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1554 microversion: 2.1 time: 0.165211 Aug 22 11:05:26.483770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 76/156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:26 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:26.778093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:26.790876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-94fb2146-d537-4764-b233-cf80276c47f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.377274 Aug 22 11:05:26.791785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 81/157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:26 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:27.197007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-e85eb3aa-0c23-4b56-8a1e-bd7dbac0183d req-9d8c3d17-3411-4f34-98f7-e0ad503ad567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da35ec84-c2f9-4fe2-a7cc-02d65039820f", "name": "network-vif-deleted", "tag": "a543a772-d3af-4a83-89ee-7d50989cb6f8"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:27.206694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-e85eb3aa-0c23-4b56-8a1e-bd7dbac0183d req-9d8c3d17-3411-4f34-98f7-e0ad503ad567 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:27.207353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-e85eb3aa-0c23-4b56-8a1e-bd7dbac0183d req-9d8c3d17-3411-4f34-98f7-e0ad503ad567 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:27.207939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-e85eb3aa-0c23-4b56-8a1e-bd7dbac0183d req-9d8c3d17-3411-4f34-98f7-e0ad503ad567 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:27.222445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-e85eb3aa-0c23-4b56-8a1e-bd7dbac0183d req-9d8c3d17-3411-4f34-98f7-e0ad503ad567 service nova] Creating event network-vif-deleted:a543a772-d3af-4a83-89ee-7d50989cb6f8 for instance da35ec84-c2f9-4fe2-a7cc-02d65039820f on hv-cinder-85394 Aug 22 11:05:27.228612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-e85eb3aa-0c23-4b56-8a1e-bd7dbac0183d req-9d8c3d17-3411-4f34-98f7-e0ad503ad567 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035820 Aug 22 11:05:27.229470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 77/158] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:27.505407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:27.506134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:27.518152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:27.521662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:27.521662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:27.521662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:27.521662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:27.522015 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:27.610808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:27.623537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-278b7670-890d-41e2-9648-75044c7ab667 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1346 microversion: 2.1 time: 0.122355 Aug 22 11:05:27.624130 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 82/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:27 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:27.812028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:27.812719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:27.822860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:27.823353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:27.823792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:27.826715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:27.827488 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:27.828153 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:28.229915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:28.237751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-27c9429c-5fae-460a-89a9-8e89449e2ae9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.429760 Aug 22 11:05:28.242173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 78/160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:27 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:28.644719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:28.646099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:28.654102 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:28.657300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:28.657300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:28.657300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:28.657300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:28.657642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:28.747947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:28.748456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:28.749041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:28.750543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lazy-loading 'fault' on Instance uuid da35ec84-c2f9-4fe2-a7cc-02d65039820f {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:05:28.930825 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7acea30e695341c8a1d83f386629a99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793621196ef245588f21b7982fe651e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:28.941754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-835e600c-db4d-4dbd-9da0-db6b07fa4e22 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 200 len: 1351 microversion: 2.1 time: 0.300722 Aug 22 11:05:28.943344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 83/161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:28 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 1351 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:29.262016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:29.267357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:29.274757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:29.275470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:29.276125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:29.276997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:29.277603 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:29.278212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:29.488584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:29.498008 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1fb339fa-7200-4ae8-a202-c479c9df63dd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.241007 Aug 22 11:05:29.502034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:29 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:29.964542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:29.965718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:29.990953 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:29.992887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:29.993483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:29.995665 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:29.996549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:29.999280 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:30.051034 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] HTTP exception thrown: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Request method failure captured: Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f HTTP/1.1 Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K6MY7FzJj8htpc8gB_KJ9j3DGuV06eRcEJ9Ir63O_FVL5I7JH1ac6Zstt8nbrBk3FK-uV1_ABogaKbT7-vlYutKCze3iqX-9NdYwDCS_S7uHwjR4wmhNCmuUTd5jJ3rkZD1iIN6qESbqrh1C_p3BoCHUiZjhHt8CtUxHfUjXa-Xuk Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:05:30.062092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/793621196ef245588f21b7982fe651e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_793621196ef245588f21b7982fe651e1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 7acea30e695341c8a1d83f386629a99b Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.063601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'da35ec84-c2f9-4fe2-a7cc-02d65039820f'} Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:05:30.064421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.065747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.071138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Returning 404 to user: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:05:30.085109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bd3f80a2-447f-4778-a0b4-8d3f13397f3f tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 404 len: 111 microversion: 2.1 time: 0.124778 Aug 22 11:05:30.086317 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 84/163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:29 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:05:30.312992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:30.315728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:30.322462 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:30.328853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:30.328853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:30.328853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:30.328853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:30.329354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:30.341707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] HTTP exception thrown: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Request method failure captured: Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f/os-volume_attachments HTTP/1.1 Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K6MY7FzJj8htpc8gB_KJ9j3DGuV06eRcEJ9Ir63O_FVL5I7JH1ac6Zstt8nbrBk3FK-uV1_ABogaKbT7-vlYutKCze3iqX-9NdYwDCS_S7uHwjR4wmhNCmuUTd5jJ3rkZD1iIN6qESbqrh1C_p3BoCHUiZjhHt8CtUxHfUjXa-Xuk Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:05:30.348216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/793621196ef245588f21b7982fe651e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_793621196ef245588f21b7982fe651e1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 7acea30e695341c8a1d83f386629a99b Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.349389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'server_id': 'da35ec84-c2f9-4fe2-a7cc-02d65039820f'} Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:05:30.350085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:30.351996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:30.360996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Returning 404 to user: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:05:30.360996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1c444e14-8530-433f-a391-9f9680817dc8 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047156 Aug 22 11:05:30.360996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 80/164] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:05:30 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:05:30.523626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:30.524541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:30.534048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:30.543306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:30.543912 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:30.551738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:30.551738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:30.551738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:30.852946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:30.861349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c4059f4d-170d-42fc-818c-efbe626dbb56 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.342885 Aug 22 11:05:30.879294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 85/165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:30 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:31.856490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:31.856993 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:31.865424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:31.866144 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:31.867521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:31.870638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:31.871366 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:31.871869 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:31.886888 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:31.887493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:31.896443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:31.905160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:31.906352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] HTTP exception thrown: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.907028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:31.907799 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Request method failure captured: Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f HTTP/1.1 Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K6MY7FzJj8htpc8gB_KJ9j3DGuV06eRcEJ9Ir63O_FVL5I7JH1ac6Zstt8nbrBk3FK-uV1_ABogaKbT7-vlYutKCze3iqX-9NdYwDCS_S7uHwjR4wmhNCmuUTd5jJ3rkZD1iIN6qESbqrh1C_p3BoCHUiZjhHt8CtUxHfUjXa-Xuk Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:05:31.909312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/793621196ef245588f21b7982fe651e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_793621196ef245588f21b7982fe651e1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 7acea30e695341c8a1d83f386629a99b Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.910509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'da35ec84-c2f9-4fe2-a7cc-02d65039820f'} Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:05:31.911439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.912477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.915206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:31.915206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:31.917450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Returning 404 to user: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:05:31.918523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f93b8a6d-d399-4b82-87ba-7279d53d1b87 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 404 len: 111 microversion: 2.1 time: 0.068161 Aug 22 11:05:31.919092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 81/166] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:05:31 2022] DELETE /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:05:31.928073 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:31.929031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] [instance: da35ec84-c2f9-4fe2-a7cc-02d65039820f] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:31.938975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:31.940289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:31.941344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:31.942070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:31.942701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:31.943134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:31.967016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] HTTP exception thrown: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Request method failure captured: Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f HTTP/1.1 Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K6MY7FzJj8htpc8gB_KJ9j3DGuV06eRcEJ9Ir63O_FVL5I7JH1ac6Zstt8nbrBk3FK-uV1_ABogaKbT7-vlYutKCze3iqX-9NdYwDCS_S7uHwjR4wmhNCmuUTd5jJ3rkZD1iIN6qESbqrh1C_p3BoCHUiZjhHt8CtUxHfUjXa-Xuk Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:05:31.969052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/793621196ef245588f21b7982fe651e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_793621196ef245588f21b7982fe651e1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/793621196ef245588f21b7982fe651e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 793621196ef245588f21b7982fe651e1 Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-DeleteServersTestJSON-1276834943 Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 7acea30e695341c8a1d83f386629a99b Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-DeleteServersTestJSON-1276834943-project Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.970438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'da35ec84-c2f9-4fe2-a7cc-02d65039820f'} Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:05:31.976600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. Aug 22 11:05:31.978104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:05:31.979751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] Returning 404 to user: Instance da35ec84-c2f9-4fe2-a7cc-02d65039820f could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:05:31.979751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6d22ad9a-961f-4356-8deb-2a1b44477610 tempest-DeleteServersTestJSON-1276834943 tempest-DeleteServersTestJSON-1276834943-project] 10.222.0.48 "GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f" status: 404 len: 111 microversion: 2.1 time: 0.047033 Aug 22 11:05:31.979751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:31 2022] GET /compute/v2.1/servers/da35ec84-c2f9-4fe2-a7cc-02d65039820f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:05:32.190639 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:32.205017 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6efe4978-f570-4db0-a6b7-19620e9fd176 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.324428 Aug 22 11:05:32.222317 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 86/168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:31 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:33.229787 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:33.230445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:33.240221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:33.241163 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:33.241945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:33.244128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:33.245341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:33.246124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:33.699949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:33.707960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a6493f90-606c-40c2-9bd0-dc9e2b0674a2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.482756 Aug 22 11:05:33.709574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 83/169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:33 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:34.735948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:34.737170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:34.770998 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:34.772272 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:34.773942 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:34.776241 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:34.776567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:34.777607 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:35.584135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:35.612375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fb2bb476-201e-4d10-99b9-6ac201bfd0d6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.883506 Aug 22 11:05:35.615652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 87/170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:34 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:36.642272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:36.643016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:36.673510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:36.674015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:36.675451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1774518676", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "networks": [{"uuid": "26039f20-9bc3-436b-86ef-d0cf1276a8ca"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:36.678418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:36.679826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:36.682778 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:36.689377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:36.817507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] validate_networks() for [('26039f20-9bc3-436b-86ef-d0cf1276a8ca', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:05:36.990863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:37.000467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8b0785ee-1bb7-4b47-9ea3-9835d7e65e54 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.363312 Aug 22 11:05:37.001479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:36 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:37.608142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:05:37.614603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:05:37.614603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:05:37.614603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:05:37.614603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:05:37.630765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:37.631255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:37.631714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:37.632442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:37.632893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:37.633320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:37.668982 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Getting quotas for project 292c489810ff42a5a7adbb7e7c251514. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:05:37.673379 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Getting quotas for user e8d3e938eea5476991577dab405323ee and project 292c489810ff42a5a7adbb7e7c251514. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:05:37.687889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:05:37.691192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:05:37.875071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0a089d58-d2c3-412a-97ae-5b9386b9aa77 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204260 Aug 22 11:05:37.882342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 88/172] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:05:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:05:37.888748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-08e1215f-69b6-496a-8d29-93a56e5ce76a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:37.890459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-08e1215f-69b6-496a-8d29-93a56e5ce76a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:38.022142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:38.023533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:38.031054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:38.065583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:38.067127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:38.071838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:38.072917 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:38.073789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:38.181760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-08e1215f-69b6-496a-8d29-93a56e5ce76a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:38.190739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-08e1215f-69b6-496a-8d29-93a56e5ce76a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1214 microversion: 2.1 time: 0.306893 Aug 22 11:05:38.203235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 85/173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:37 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:38.716364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:38.734874 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df5f67c7-f122-4cd1-9e13-9b53dd24c74d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.715023 Aug 22 11:05:38.742858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 89/174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:38 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:39.217162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-05bc2cb1-4c13-438a-9d58-782cab3dc6f7 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:39.218737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-05bc2cb1-4c13-438a-9d58-782cab3dc6f7 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:39.403353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-05bc2cb1-4c13-438a-9d58-782cab3dc6f7 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:39.414960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-05bc2cb1-4c13-438a-9d58-782cab3dc6f7 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1214 microversion: 2.1 time: 0.201793 Aug 22 11:05:39.417008 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 86/175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:39 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:39.755931 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:39.756633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:39.781762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:39.786462 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:39.787938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:39.813309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:39.813912 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:39.816384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:39.821407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:40.089204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:40.099205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-17422c2c-acb8-4753-88ce-50229471f3fe tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.347593 Aug 22 11:05:40.100672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 90/176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:39 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:40.440848 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:40.443182 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:40.460744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:40.461961 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:40.463377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:40.464766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:40.466191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:40.467142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:40.555027 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:40.563069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c9b17bc6-7985-4509-9bde-33ba2a46d37f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1218 microversion: 2.1 time: 0.129899 Aug 22 11:05:40.568872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 87/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:40 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:41.126545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:41.127927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:41.136876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:41.137670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:41.138337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:41.139536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:41.140199 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:41.141077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:41.361337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:41.372114 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c51844b0-be2d-45c3-ad2e-15424ff34e4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.252122 Aug 22 11:05:41.372862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 91/178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:41 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:41.585626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:41.586193 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:41.596722 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:41.597531 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:41.598610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:41.599525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:41.604184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:41.604727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:41.726105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:41.734418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-312c4d6e-6daa-4c9b-8bef-7861911d83a2 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1266 microversion: 2.1 time: 0.152559 Aug 22 11:05:41.747452 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 88/179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:41 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:42.394353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:42.395003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:42.407949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:42.408746 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:42.409891 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:42.411621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:42.412075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:42.413796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:42.596062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:42.605635 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8241b1bd-78a8-4506-8c33-d2a8f39fb5d9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1523 microversion: 2.1 time: 0.216354 Aug 22 11:05:42.608889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 92/180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:42 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:42.762214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:42.763589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:42.773762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:42.774264 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:42.774704 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:42.779932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:42.780575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:42.781012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:42.909991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:42.925548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-acdb8d8d-a27c-44e2-834f-63132193bcd6 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1274 microversion: 2.1 time: 0.167573 Aug 22 11:05:42.926136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 89/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:42 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:43.632497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:43.633165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:43.642051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:43.642728 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:43.643177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:43.644046 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:43.644509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:43.644938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:43.961727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:43.962398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:43.973238 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:43.975723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:43.977841 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:43.980959 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:43.982005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:43.983035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:43.997459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:44.039049 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:44.052783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-682eaa5e-c50e-46cc-9725-c79bb164101e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1503 microversion: 2.1 time: 0.427453 Aug 22 11:05:44.062288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 93/182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:43 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:44.074525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:44.077984 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:44.088320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:44.089453 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:44.090087 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:44.091001 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:44.091633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:44.092240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:44.122560 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:44.139934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a908487c-b022-45e2-b892-6aa5b807a345 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1272 microversion: 2.1 time: 0.188042 Aug 22 11:05:44.140931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 90/183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:43 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:44.369557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:44.379451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-18144984-e020-4965-8ea8-1e21415071fa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1516 microversion: 2.1 time: 0.308924 Aug 22 11:05:44.380648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 94/184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:44 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:45.161795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:45.164154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:45.174989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:45.176156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:45.176908 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:45.178818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:45.179996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:45.180726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:45.448040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:45.464697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b779b59c-8754-417b-a00e-156e8487375c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.307443 Aug 22 11:05:45.484518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 91/185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:45 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:45.558327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-844aa43e-0f8b-43c9-8a41-29f33f3bc05b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Action: 'create', calling method: .version_select at 0x7f3b4c7fe430>, body: {"keypair": {"name": "tempest-TestShelveInstance-64800378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoiKyl+mMcUdbyszm9ah0iGMUon8EowIVuA9/DhuQbk9+SmJYK2h4wuT1aqBiBf3/Eun8klt4gSkTu3onxHXuDL5iCdwfuosxtN8iQuxN62IvkGVqPkcpJPsedLRCc7Fw=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:45.580497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-844aa43e-0f8b-43c9-8a41-29f33f3bc05b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Getting quotas for project e7e01f19882d4b6eb2498d59aa8ad78f. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:05:45.593806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-844aa43e-0f8b-43c9-8a41-29f33f3bc05b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Getting quotas for user ce5e17020ce0436ca26936c73c4d4514 and project e7e01f19882d4b6eb2498d59aa8ad78f. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:05:45.719666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-844aa43e-0f8b-43c9-8a41-29f33f3bc05b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.525413 Aug 22 11:05:45.726065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 95/186] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:05:45 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:45.728415 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-c3f422ad-e93e-4b8a-a7d5-04d7010b3785 req-bc3fac92-58a5-4ced-b057-fbad52d7f534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36323184-8758-4acd-8ff2-f5b5def1e257", "tag": "a9728e0d-7d42-427e-8d5e-2d6249f7c797"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:45.738741 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-c3f422ad-e93e-4b8a-a7d5-04d7010b3785 req-bc3fac92-58a5-4ced-b057-fbad52d7f534 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:45.739541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-c3f422ad-e93e-4b8a-a7d5-04d7010b3785 req-bc3fac92-58a5-4ced-b057-fbad52d7f534 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:45.739980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-c3f422ad-e93e-4b8a-a7d5-04d7010b3785 req-bc3fac92-58a5-4ced-b057-fbad52d7f534 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:45.761478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-c3f422ad-e93e-4b8a-a7d5-04d7010b3785 req-bc3fac92-58a5-4ced-b057-fbad52d7f534 service nova] Creating event network-changed:a9728e0d-7d42-427e-8d5e-2d6249f7c797 for instance 36323184-8758-4acd-8ff2-f5b5def1e257 on hv-cinder-85394 Aug 22 11:05:45.769158 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-c3f422ad-e93e-4b8a-a7d5-04d7010b3785 req-bc3fac92-58a5-4ced-b057-fbad52d7f534 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045344 Aug 22 11:05:45.769756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 92/187] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:46.491527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:46.492359 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:46.505826 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:46.506484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:46.507042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:46.508193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:46.509504 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:46.510166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:46.528523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:46.531353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:46.545448 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:46.551385 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:46.551841 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:46.552572 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:46.553605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:46.554032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:46.604713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lazy-loading 'flavor' on Instance uuid 819ff9d5-279f-46b0-977d-98240e33a48b {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:05:46.816765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:46.827171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-93edcaa1-0fbc-4473-bd1b-404481bab3d0 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.342412 Aug 22 11:05:46.828439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 96/188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:46 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:47.043604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8a87a5dc-07cf-42fa-a4de-a7f5da359999 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/action" status: 200 len: 32 microversion: 2.1 time: 0.517587 Aug 22 11:05:47.045375 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 93/189] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:05:46 2022] POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/action => generated 32 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:05:47.055037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:47.055679 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:47.070467 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:47.072150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:47.072781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:47.076289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:47.076944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:47.077534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:47.282648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:47.294814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df5e4e0e-ef33-4651-80be-6c501833df24 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.244299 Aug 22 11:05:47.296467 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 97/190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:47 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:47.852699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:47.859644 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:47.874968 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:47.875682 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:47.876267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:47.877129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:47.877582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:47.878018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:48.062683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:48.078213 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6f6728fc-b9ef-4292-8a41-3504e8373a34 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.232749 Aug 22 11:05:48.079362 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 94/191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:47 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:48.318623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:48.320790 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:48.323468 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:48.337116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:48.347089 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:48.347558 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:48.348311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:48.350846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:48.351465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:48.507779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:48.534216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6ccc4241-9710-4431-bfcc-d9866df3ecac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.216641 Aug 22 11:05:48.536478 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 98/192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:48 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:49.105608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:49.108103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:49.113915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:49.114657 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:49.115140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:49.116180 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:49.116628 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:49.117211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:49.327782 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:49.337596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-88b7cbc8-4245-482f-a5c3-95c7e465c3af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.237674 Aug 22 11:05:49.339893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 95/193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:49 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:49.556852 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:49.557486 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:49.563960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:49.564434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:49.564894 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:49.565568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:49.566018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:49.566466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:49.704818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:49.712670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-427c6cec-8955-409d-b407-2efd42b6e694 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.160613 Aug 22 11:05:49.713229 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 99/194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:49 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:50.359759 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:50.360406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:50.362440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:50.367469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:50.367948 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:50.368379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:50.369070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:50.369518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:50.372336 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:50.531188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:50.540151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2d4cf2f0-b1d7-4d4e-be0f-58d528777c60 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.184646 Aug 22 11:05:50.540986 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 96/195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:50 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:50.734465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:50.735328 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:50.742172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:50.742632 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:50.743065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:50.743758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:50.744204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:50.744622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:50.921384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:50.929516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-72919f99-d2d5-401f-969d-a1f800e1d175 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.199166 Aug 22 11:05:50.930080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 100/196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:50 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:51.563296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:51.564605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:51.566978 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=54 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:51.572477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:51.572973 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:51.573418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:51.581316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:51.581316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:51.581316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:51.720568 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:51.729704 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-367238d9-f922-4cb6-8635-f5c78bd605cf tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.170786 Aug 22 11:05:51.730403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 97/197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:51 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:51.954387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:51.955192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:51.963317 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:51.964692 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:51.965309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:51.966028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:51.966518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:51.967000 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:52.108468 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:52.116105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-158daa0d-8b28-4ba2-a65b-975324febf04 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.168474 Aug 22 11:05:52.116670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 101/198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:51 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:52.375979 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-1e9b3b30-252e-4972-972f-8df439014855 req-42bd296d-8449-402a-994a-ab3e5ff2efa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36323184-8758-4acd-8ff2-f5b5def1e257", "name": "network-vif-plugged", "status": "completed", "tag": "a9728e0d-7d42-427e-8d5e-2d6249f7c797"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:52.386058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-1e9b3b30-252e-4972-972f-8df439014855 req-42bd296d-8449-402a-994a-ab3e5ff2efa6 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:52.386574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-1e9b3b30-252e-4972-972f-8df439014855 req-42bd296d-8449-402a-994a-ab3e5ff2efa6 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:52.387005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-1e9b3b30-252e-4972-972f-8df439014855 req-42bd296d-8449-402a-994a-ab3e5ff2efa6 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:52.397810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-1e9b3b30-252e-4972-972f-8df439014855 req-42bd296d-8449-402a-994a-ab3e5ff2efa6 service nova] Creating event network-vif-plugged:a9728e0d-7d42-427e-8d5e-2d6249f7c797 for instance 36323184-8758-4acd-8ff2-f5b5def1e257 on hv-cinder-85394 Aug 22 11:05:52.403370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-1e9b3b30-252e-4972-972f-8df439014855 req-42bd296d-8449-402a-994a-ab3e5ff2efa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031400 Aug 22 11:05:52.403994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 98/199] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:52.751846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:52.752545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:52.758691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:52.759171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:52.759770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:52.760451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:52.760898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:52.761313 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:52.900690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:52.908598 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0988e86e-0a8a-42a7-8798-d06b398d8f1b tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.160642 Aug 22 11:05:52.909164 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 102/200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:52 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:53.138330 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:53.139017 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:53.145071 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:53.145576 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:53.146005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:53.146714 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:53.147157 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:53.147697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:53.312479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:53.322380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5af9aadf-d423-4f15-80ce-898274ac70c9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.188473 Aug 22 11:05:53.323080 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 99/201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:53 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:53.929489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:53.930847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:53.933174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:53.937973 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:53.938498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:53.938938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:53.939707 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:53.940112 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:53.940724 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:54.099242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:54.108788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f9c672c5-7432-4349-92d5-a9860a19b9fc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1314 microversion: 2.1 time: 0.183317 Aug 22 11:05:54.109360 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 103/202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:53 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:54.345445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:54.346051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:54.353135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:54.353731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:54.354356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:54.355149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:54.355602 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:54.356197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:54.538812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:54.551715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9bab5aa2-d49f-495b-a0a4-6c7111afa369 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.210495 Aug 22 11:05:54.556647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 100/203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:54 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:54.675655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:54.676701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:54.688705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:54.688705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:54.688705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:54.688705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:54.688989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:54.688989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:54.713060 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bdaeb772-23cd-4579-b67e-0572dfbcd76d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/ips" status: 200 len: 151 microversion: 2.20 time: 0.041729 Aug 22 11:05:54.713905 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 104/204] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 22 11:05:54 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 11:05:55.133072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:55.133694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:55.140272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:55.140615 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:55.141060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:55.141762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:55.142235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:55.142791 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:55.299891 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:55.307954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a981671d-a093-4507-9062-a3f35285985c tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1499 microversion: 2.1 time: 0.179427 Aug 22 11:05:55.308525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 101/205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:55 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1499 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:55.575236 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:55.575895 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:55.583143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:55.583813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:55.584136 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:55.585958 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:55.586454 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:55.586885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:55.602785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=10 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:55.731067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:55.740480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ebda434f-bf97-4fa2-9211-3930c370eb80 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.169197 Aug 22 11:05:55.741803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 105/206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:55 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:56.573169 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:56.573737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:56.579696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:56.580188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:56.580608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:56.581308 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:56.581765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:56.582250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:56.608850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:05:56.761690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:56.762285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:56.769109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:56.769594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:56.770027 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:56.770763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:56.771421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:56.771840 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:56.909214 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:56.917910 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dbbfffc6-826c-4a48-9054-b0d2f4e9e7ac tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.160610 Aug 22 11:05:56.918515 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 106/207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:56 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:56.979639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-45fa9bb7-087c-4626-a343-fc49a476a491 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "DELETE /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 204 len: 0 microversion: 2.1 time: 0.410493 Aug 22 11:05:56.980218 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 102/208] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:05:56 2022] DELETE /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:05:56.989513 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:56.990117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:56.996232 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:56.996714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:56.999889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:56.999889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:56.999889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:56.999889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:57.140077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:57.151512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7616498b-7ed0-4b30-ad4f-d3d6b43f581f tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1505 microversion: 2.1 time: 0.165753 Aug 22 11:05:57.152099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 107/209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:56 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:57.579183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:57.579737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:57.586168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:57.586679 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:57.587106 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:57.587781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:57.588220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:57.588638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:57.615738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-163d7d0b-6875-4a25-8ee9-915a3641a479 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/ips" status: 200 len: 149 microversion: 2.1 time: 0.040271 Aug 22 11:05:57.617411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 103/210] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:05:57 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:57.939084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:57.939767 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:57.947851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:57.948336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:57.948794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:57.949485 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:57.949938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:57.950399 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:57.952967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:58.086290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:58.093984 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-06ad4bc6-7896-48c6-b890-072a2fa398a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.159053 Aug 22 11:05:58.094579 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 108/211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:57 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:58.205990 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:58.206627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:58.213428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:58.217257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:58.217257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:58.217257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:58.217257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:58.217636 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:58.359377 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:58.361527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:05:58.371282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-825514bf-5a69-43e4-9518-e26473fff762 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1505 microversion: 2.1 time: 0.168820 Aug 22 11:05:58.371885 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 104/212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:58 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:58.529263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:58.529803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:58.535871 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:58.536381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:58.536812 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:58.538294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:58.538754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:58.539177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:58.562184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lazy-loading 'flavor' on Instance uuid 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:05:59.117798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:59.119256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:59.126794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.127265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.127691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.128379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.128980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.129447 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.162188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-45f3e7bc-bf75-4aad-bbf6-c4d319e49c5f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/action" status: 202 len: 0 microversion: 2.20 time: 0.636570 Aug 22 11:05:59.163491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 109/213] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 22 11:05:58 2022] POST /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:05:59.171953 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:59.172641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:59.179814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.180285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.180715 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.181410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.181858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.182637 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.324289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:59.338167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f4bea7a7-578f-4985-bb78-9ca66a8954d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.226834 Aug 22 11:05:59.339157 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 105/214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:59 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:05:59.343720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-d0ed47bd-6947-4fcd-8f96-a1ca1cef25ed req-2c297446-8722-49be-8239-960b5a276c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36323184-8758-4acd-8ff2-f5b5def1e257", "name": "network-vif-deleted", "tag": "a9728e0d-7d42-427e-8d5e-2d6249f7c797"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:59.353921 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d0ed47bd-6947-4fcd-8f96-a1ca1cef25ed req-2c297446-8722-49be-8239-960b5a276c29 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.355541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d0ed47bd-6947-4fcd-8f96-a1ca1cef25ed req-2c297446-8722-49be-8239-960b5a276c29 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.355694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d0ed47bd-6947-4fcd-8f96-a1ca1cef25ed req-2c297446-8722-49be-8239-960b5a276c29 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.368138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-d0ed47bd-6947-4fcd-8f96-a1ca1cef25ed req-2c297446-8722-49be-8239-960b5a276c29 service nova] Creating event network-vif-deleted:a9728e0d-7d42-427e-8d5e-2d6249f7c797 for instance 36323184-8758-4acd-8ff2-f5b5def1e257 on hv-cinder-85394 Aug 22 11:05:59.374026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-d0ed47bd-6947-4fcd-8f96-a1ca1cef25ed req-2c297446-8722-49be-8239-960b5a276c29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Aug 22 11:05:59.378314 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 106/215] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:05:59.395198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:05:59.395974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:59.409716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.410200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.411132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.411816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.412258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.413355 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.489155 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:59.497544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-00e906b5-d1d5-4f63-9250-96cb710f2853 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 200 len: 1463 microversion: 2.1 time: 0.106699 Aug 22 11:05:59.498116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 107/216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:05:59 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 1463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:05:59.504299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a405d4d4-da1e-4067-b3d6-b8436edbd17c"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:05:59.506828 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:05:59.515086 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.515849 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.516445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.517343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:05:59.517794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:05:59.518221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:05:59.527397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:59.536013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:59.537607 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:05:59.538808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d63a7d4d-2ed4-4864-b4f7-d6d25d3cc753 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.370950 Aug 22 11:05:59.539368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 110/217] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:05:59 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:00.166119 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-348f2167-827f-4750-b7bb-6d3c116d2a7c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666287 Aug 22 11:06:00.168935 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 108/218] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:05:59 2022] POST /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:00.368051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:00.371948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:00.391896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:00.391896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:00.391896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:00.391896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:00.392493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:00.392493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:00.530949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:00.531942 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 36323184-8758-4acd-8ff2-f5b5def1e257] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:00.540821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:00.541810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:00.542450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:00.543560 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:00.544157 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:00.544721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:00.551644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:00.560724 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0ace6e17-44f6-428b-a780-8d7fd0debef2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.202715 Aug 22 11:06:00.561413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 111/219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:00 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] HTTP exception thrown: Instance 36323184-8758-4acd-8ff2-f5b5def1e257 could not be found. Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Request method failure captured: Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 HTTP/1.1 Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2L-PvlVsKVgxmGgcmfPPgBp1vXFPkT-iSCLm2DcYyhgVd0nazw7fBJHJFePXPeGW9rep63m2sqK5-H0F1kN2lgYDk79sLLZ8DLDS2QRXGVkZ6HuPl0bufaEF3EsZe2OtaOC_868B798FhTyCv4vDLCUAbyMPibJMLYvK1FPzYxPLDg Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 292c489810ff42a5a7adbb7e7c251514 Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-VolumesActionsTest-307717966 Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:06:00.574405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/292c489810ff42a5a7adbb7e7c251514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/292c489810ff42a5a7adbb7e7c251514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_292c489810ff42a5a7adbb7e7c251514", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/292c489810ff42a5a7adbb7e7c251514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-VolumesActionsTest-307717966 Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 292c489810ff42a5a7adbb7e7c251514 Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-VolumesActionsTest-307717966 Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-VolumesActionsTest-307717966-project Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: e8d3e938eea5476991577dab405323ee Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-VolumesActionsTest-307717966-project Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 36323184-8758-4acd-8ff2-f5b5def1e257 could not be found. Aug 22 11:06:00.576315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '36323184-8758-4acd-8ff2-f5b5def1e257'} Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36323184-8758-4acd-8ff2-f5b5def1e257 could not be found. Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:06:00.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36323184-8758-4acd-8ff2-f5b5def1e257 could not be found. Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36323184-8758-4acd-8ff2-f5b5def1e257 could not be found. Aug 22 11:06:00.583137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:00.584522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Returning 404 to user: Instance 36323184-8758-4acd-8ff2-f5b5def1e257 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:06:00.584522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8f6a81ec-6853-4866-a288-68804fe36030 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257" status: 404 len: 111 microversion: 2.1 time: 0.043662 Aug 22 11:06:00.584522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 109/220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:00 2022] GET /compute/v2.1/servers/36323184-8758-4acd-8ff2-f5b5def1e257 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:06:00.584845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:00.584845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:00.584845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:00.584845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:00.585178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:00.585178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:00.585178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:00.585178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:00.712380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1473187702", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "networks": [{"uuid": "26039f20-9bc3-436b-86ef-d0cf1276a8ca"}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:00.772627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] validate_networks() for [('26039f20-9bc3-436b-86ef-d0cf1276a8ca', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:06:00.996277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:01.005046 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:01.008746 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:01.008746 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cf527f15-52ae-4fb3-a1ac-15a4c8c41a8e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.446156 Aug 22 11:06:01.009255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 112/221] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:00 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:01.152210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:06:01.152624 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:06:01.153097 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:06:01.153490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:06:01.153890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:06:01.162709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:01.163191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:01.163608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:01.164310 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:01.164803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:01.165216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:01.182406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Getting quotas for project 292c489810ff42a5a7adbb7e7c251514. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:06:01.186211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Getting quotas for user e8d3e938eea5476991577dab405323ee and project 292c489810ff42a5a7adbb7e7c251514. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:06:01.197293 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:06:01.199630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:06:01.337256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9f48ce4f-a068-45c8-bf56-cff8540429af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629080 Aug 22 11:06:01.337904 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 110/222] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 11:06:01.348548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-228f1604-7ae9-4af2-abc8-86751fd75b26 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:01.349146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-228f1604-7ae9-4af2-abc8-86751fd75b26 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:01.405201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-228f1604-7ae9-4af2-abc8-86751fd75b26 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:01.411878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-228f1604-7ae9-4af2-abc8-86751fd75b26 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1214 microversion: 2.1 time: 0.067177 Aug 22 11:06:01.413111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 113/223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:01 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:01.590780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:01.591590 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:01.599305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:01.603147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:01.603147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:01.603147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:01.603147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:01.603631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:01.752148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:01.758341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0d602e00-77bd-44a4-a179-82331e2617aa tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.171425 Aug 22 11:06:01.773442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 111/224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:01 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:02.032883 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:02.033629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:02.043752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:02.044250 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:02.044750 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:02.045458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:02.046062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:02.046541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:02.180014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:02.188150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:02.189648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:02.190833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-30bf63e0-332a-4e2d-806d-7af3c5353d62 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.161854 Aug 22 11:06:02.191386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 114/225] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:02 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:02.433820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:02.434453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:02.440634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:02.441112 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:02.441544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:02.442246 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:02.442699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:02.446284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:02.505060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:02.513372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d589dfe9-1e0e-47c9-ac40-19d471f8362a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1218 microversion: 2.1 time: 0.083490 Aug 22 11:06:02.514713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 112/226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:02 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:02.782253 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:02.783047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:02.790986 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:02.791465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:02.791893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:02.792582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:02.793030 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:02.793450 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:02.940403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:02.948272 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-38775197-e50c-4af7-ad80-b02c5a120821 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.171109 Aug 22 11:06:02.948804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 115/227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:02 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:03.214291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:03.214919 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:03.224456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:03.224962 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:03.225397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:03.226804 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:03.227177 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:03.227635 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:03.365219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:03.375758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:03.377211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:03.378472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b91f00b3-9a0f-4549-9f3e-026558e1d479 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.168700 Aug 22 11:06:03.378950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 113/228] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:03 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:03.534525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:03.535138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:03.541272 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:03.541761 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:03.542196 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:03.542912 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:03.543364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:03.543787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:03.638107 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:03.645874 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9b0a37e7-bd2c-4022-b837-9af0a965a259 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1274 microversion: 2.1 time: 0.115247 Aug 22 11:06:03.646474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 116/229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:03 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:03.969540 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:03.970351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:03.977205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:03.980633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:03.980633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:03.980633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:03.980633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:03.980967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:04.112886 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:04.124535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b8d54d42-315b-41ff-b14d-ab2b9bd71b77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.156802 Aug 22 11:06:04.124535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 114/230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:03 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:04.401873 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:04.403287 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:04.410506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:04.411390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:04.411983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:04.413011 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:04.413616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:04.416169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:04.664436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:04.669217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:04.674284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:04.675310 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:04.676502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:04.677811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-62d6b6b9-3a71-4e82-b24d-50eb59b5f794 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.280822 Aug 22 11:06:04.682787 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:04.683528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:04.684402 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:04.685344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:04.685929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:04.686575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:04.694793 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 117/231] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:04 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:04.840902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:04.848624 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0501a154-2094-4475-988a-d70e279e2542 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.184502 Aug 22 11:06:04.862830 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 115/232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:04 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:05.121108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-44dfdf7f-3159-45e8-ad7b-c32e0e2d3361 req-8d8dfed9-24f5-45c2-b551-e2006c12af79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78760983-818c-49f0-b03d-099deb32c0b9", "tag": "2dc30772-ddee-4ca5-83be-e3d8cf74b4d0"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:05.135942 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-44dfdf7f-3159-45e8-ad7b-c32e0e2d3361 req-8d8dfed9-24f5-45c2-b551-e2006c12af79 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.136589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-44dfdf7f-3159-45e8-ad7b-c32e0e2d3361 req-8d8dfed9-24f5-45c2-b551-e2006c12af79 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.136970 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-44dfdf7f-3159-45e8-ad7b-c32e0e2d3361 req-8d8dfed9-24f5-45c2-b551-e2006c12af79 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.145187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:05.146427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:05.150816 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-44dfdf7f-3159-45e8-ad7b-c32e0e2d3361 req-8d8dfed9-24f5-45c2-b551-e2006c12af79 service nova] Creating event network-changed:2dc30772-ddee-4ca5-83be-e3d8cf74b4d0 for instance 78760983-818c-49f0-b03d-099deb32c0b9 on hv-cinder-85394 Aug 22 11:06:05.154689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-44dfdf7f-3159-45e8-ad7b-c32e0e2d3361 req-8d8dfed9-24f5-45c2-b551-e2006c12af79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038030 Aug 22 11:06:05.155642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.155900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 118/233] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:05.156641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.157176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.157984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.158491 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.158905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.302646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:05.311922 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cfb1a334-64ea-46bf-be15-9e8fb990a38d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.171567 Aug 22 11:06:05.312586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 116/234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:05 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:05.702443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:05.703244 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:05.709889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.710563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.711174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.711885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.712341 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.712897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.878160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:05.878988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:05.886984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.887672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.888277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.889113 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:05.889704 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:05.890476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:05.926753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:05.936026 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:05.937527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:05.938906 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-89f156a8-4f03-4a89-a08d-e4130cd8e22e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.241345 Aug 22 11:06:05.940856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 119/235] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:05 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:06.043130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:06.050696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dce9bc56-4bac-4315-811e-14dd910d6697 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.176910 Aug 22 11:06:06.055485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 117/236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:05 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:06.333885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:06.334555 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:06.341067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:06.341524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:06.342001 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:06.342710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:06.343158 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:06.343575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:06.473864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:06.481533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-de6a3bb2-72b4-4fea-a98c-ca4b85801c28 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.151479 Aug 22 11:06:06.482110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:06 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:06.975605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:06.976860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:06.983904 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:06.984393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:06.984969 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:06.985525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:06.985976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:06.986422 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.074059 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:07.074712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:07.081902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.082428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.082871 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.083575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.084029 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.085488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.144915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:07.157860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:07.159516 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:07.160989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-873002bc-1c04-4f1b-b40b-b60f85fe3f6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.189293 Aug 22 11:06:07.174743 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 118/238] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:06 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:07.227187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:07.235422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-59b20ba5-2d46-462b-a078-10d562c74f02 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.166127 Aug 22 11:06:07.235994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 121/239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:07 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:07.503642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:07.504666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:07.512075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.512699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.513343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.514206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.514829 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.515413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.655174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:07.666092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-88e82c19-0dde-45ca-bf50-2682733aa457 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1502 microversion: 2.1 time: 0.166507 Aug 22 11:06:07.666814 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 119/240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:07 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:07.688956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6acb5a0c-b2d0-4e04-a70c-d67fb84817e9"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:07.691833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:07.699550 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.700277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.700862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.701706 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.702453 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.707885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.728299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] HTTP exception thrown: Cannot 'attach_volume' instance 819ff9d5-279f-46b0-977d-98240e33a48b while it is in vm_state rescued Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Request method failure captured: Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/os-volume_attachments HTTP/1.1 Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 74 Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K4VPSfrEmSjxqKPp3GzLTG_GldlBtAqF8U7AEJ02UvMsGRiwjuhYgyZ7Mg3TCdeKVJE7oBebf3PBSTNyGQ3GyCvQznzFNRUA7OCBrgPh7oMsQ07BCVXzTNERgNF7JvChaLCeRTClI1YoV3HBTE0FXwpqtnGFn1THAE1P8dmPV3lkw Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:06:07.730003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2cb7651353884366b2ca72a7e272bdc0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 7c6fee0b956e41a7b2d9b914043633ea Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {"volumeAttachment": {"volumeId": "6acb5a0c-b2d0-4e04-a70c-d67fb84817e9"}} Aug 22 11:06:07.731265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Cannot 'attach_volume' instance 819ff9d5-279f-46b0-977d-98240e33a48b while it is in vm_state rescued Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '819ff9d5-279f-46b0-977d-98240e33a48b', 'body': {'volumeAttachment': {'volumeId': '6acb5a0c-b2d0-4e04-a70c-d67fb84817e9'}}} Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 819ff9d5-279f-46b0-977d-98240e33a48b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:06:07.731967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 819ff9d5-279f-46b0-977d-98240e33a48b while it is in vm_state rescued Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:06:07.733338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 819ff9d5-279f-46b0-977d-98240e33a48b while it is in vm_state rescued Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Returning 409 to user: Cannot 'attach_volume' instance 819ff9d5-279f-46b0-977d-98240e33a48b while it is in vm_state rescued {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e6f58fe-3c48-4060-9833-db3781de43ce tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048512 Aug 22 11:06:07.748240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 122/241] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:06:07 2022] POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 11:06:07.748766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:07.748766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:07.748766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.749160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.749586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:07.750290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:07.750729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:07.751146 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.054755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-97ab9aa3-8ee0-4360-a5cb-7b2b0f2010be tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/action" status: 202 len: 0 microversion: 2.1 time: 0.315411 Aug 22 11:06:08.055826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 120/242] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:06:07 2022] POST /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:06:08.063784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:08.064428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:08.071672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:08.072224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:08.072590 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.073342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:08.073796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:08.074267 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.187029 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:08.187902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:08.194374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:08.195091 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:08.195684 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.196479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:08.197032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:08.197556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.202164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:08.211634 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:08.219364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a88d7370-3ce5-4d29-b8e3-8aa4aa304d60 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1510 microversion: 2.1 time: 0.159474 Aug 22 11:06:08.222860 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 123/243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:08 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:08.258418 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:08.259804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:08.265077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:08.265559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:08.265992 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.266720 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:08.267211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:08.267626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:08.424989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:08.429410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:08.438162 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-912c6d04-e2a3-4a02-81a0-591bb6c69284 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.184865 Aug 22 11:06:08.440915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 124/244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:08 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:08.531525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:08.540383 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:08.541976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:08.543113 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6425a1fe-af1d-43db-85a0-1fe327c33eec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.361956 Aug 22 11:06:08.543673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 121/245] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:08 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:09.106766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-640094517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-64800378", "security_groups": [{"name": "tempest-secgroup-smoke-1843482559"}], "networks": [{"uuid": "662f800f-4bd4-4b69-ad53-c17a28fc59f8"}], "block_device_mapping_v2": [{"uuid": "855b07a9-fb31-491a-9b9e-931c550413dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:09.243593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:09.246555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:09.259304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.259840 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.260344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.261107 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.261583 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.262139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.283878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] validate_networks() for [('662f800f-4bd4-4b69-ad53-c17a28fc59f8', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:06:09.584784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:09.593391 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-15e43c90-db0d-45ec-bc4a-6cfbf8e6b42e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1510 microversion: 2.1 time: 0.355973 Aug 22 11:06:09.606649 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 122/246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:09 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:09.612585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:09.613197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:09.628926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.629431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.630631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.631840 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.632334 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.632764 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.776021 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:09.784179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-addceb26-e134-4fbb-8f4d-9f5ecc1a7042 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.176216 Aug 22 11:06:09.784976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 123/247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:09 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:09.807899 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:09.808532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:09.821282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.822093 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.822567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.823276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.823728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.824148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.848478 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:06:09.850752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:06:09.852865 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:06:09.853380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:06:09.853894 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:06:09.881152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.882558 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.885846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.886960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:09.887649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:09.888288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:09.911128 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Getting quotas for project e7e01f19882d4b6eb2498d59aa8ad78f. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:06:09.915669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Getting quotas for user ce5e17020ce0436ca26936c73c4d4514 and project e7e01f19882d4b6eb2498d59aa8ad78f. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:06:09.970890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:09.980796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:09.983072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:09.983225 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:06:09.984236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-295dcafb-f081-4196-b5e9-943c1f9e5291 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.190808 Aug 22 11:06:09.984927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 124/248] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:09 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:09.985451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='855b07a9-fb31-491a-9b9e-931c550413dc',volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:06:09.989752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6e30d037-bc6a-4e2e-b2d4-afc9f068009d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: .version_select at 0x7f3b4ca0b670>, body: {"keypair": {"name": "tempest-keypair-1137023031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIeigDHvMOM6fBg0/EBD2ATX+30kHi0bHALnub8tb4hbpboJw0Yx4NVC9udU9Kzo7XLVDyPMveWRaFNG7wwGa0ZYSTQ54g4ffwLYfLqCwH5bj/nCFsIR+ukpC4CCj5NRw=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:10.019010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-6e30d037-bc6a-4e2e-b2d4-afc9f068009d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:06:10.023951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-6e30d037-bc6a-4e2e-b2d4-afc9f068009d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:06:10.140128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6e30d037-bc6a-4e2e-b2d4-afc9f068009d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153809 Aug 22 11:06:10.141750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 125/249] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:06:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:10.449231 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d9389f2-eee6-4fd0-b409-093bcc01f4fe tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.346244 Aug 22 11:06:10.449966 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 125/250] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:06:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 11:06:10.461236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a25a801e-697a-4f6b-ab6d-cba07dee95ae tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:10.461846 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a25a801e-697a-4f6b-ab6d-cba07dee95ae tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:10.528006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a25a801e-697a-4f6b-ab6d-cba07dee95ae tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:10.535966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a25a801e-697a-4f6b-ab6d-cba07dee95ae tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1086 microversion: 2.1 time: 0.078922 Aug 22 11:06:10.536532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 126/251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:10 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1086 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:10.614687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:10.615298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:10.622155 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:10.622684 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:10.623160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:10.623892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:10.624347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:10.624779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:10.801727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:10.806648 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:10.807414 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:10.813167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-29f37256-0a68-4a38-bc79-45ced5fceeea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1510 microversion: 2.1 time: 0.202304 Aug 22 11:06:10.817651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:10.817870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 126/252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:10 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:10.817946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:10.817946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:10.817946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:10.817946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:10.818271 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:11.012924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:11.013955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:11.014597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:11.021206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-52e8a331-2562-418b-ad8d-524461067adc tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.220262 Aug 22 11:06:11.022342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 127/253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:10 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:11.029010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:11.029583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:11.030136 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:11.030915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:11.031362 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:11.031779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:11.193374 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:11.201701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:11.203256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:11.204416 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-50f3dc36-c72d-467c-8660-36729da71c2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.194469 Aug 22 11:06:11.204979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 127/254] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:11 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:11.556595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-17c22829-cb8c-4581-a491-6f44e8032be9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:11.557211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-17c22829-cb8c-4581-a491-6f44e8032be9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:11.559098 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:11.625037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-17c22829-cb8c-4581-a491-6f44e8032be9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:11.632678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-17c22829-cb8c-4581-a491-6f44e8032be9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1086 microversion: 2.1 time: 0.080668 Aug 22 11:06:11.633257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 128/255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:11 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1086 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:11.835959 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:11.836563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:11.842543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:11.843024 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:11.843461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:11.844187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:11.844638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:11.845058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.044365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:12.045302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:12.063992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.064510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.065126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.065847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.066340 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.066765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.112994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:12.122745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d7b10820-3497-489c-9c32-129a78c35f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1510 microversion: 2.1 time: 0.291169 Aug 22 11:06:12.130725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 128/256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:11 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:12.225269 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:12.227909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:12.228524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:12.235511 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.236004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.236439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.236612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0b74f2d3-9be1-48bc-b2aa-546ebb1d1607 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.196336 Aug 22 11:06:12.237427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.237577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 129/257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:12 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:12.237886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.238513 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.461135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:12.470592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:12.472353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:12.473699 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6d17d469-d190-44b3-8c00-2c8b498b4265 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.249803 Aug 22 11:06:12.486694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 129/258] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:12 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:12.523121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-b6ff2993-366a-44e3-a087-9a424b286f32 req-2d1dc2bb-c1e6-4d06-a9b2-7e0b2afd692b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78760983-818c-49f0-b03d-099deb32c0b9", "name": "network-vif-plugged", "status": "completed", "tag": "2dc30772-ddee-4ca5-83be-e3d8cf74b4d0"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:12.528294 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:12.533349 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b6ff2993-366a-44e3-a087-9a424b286f32 req-2d1dc2bb-c1e6-4d06-a9b2-7e0b2afd692b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.533977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b6ff2993-366a-44e3-a087-9a424b286f32 req-2d1dc2bb-c1e6-4d06-a9b2-7e0b2afd692b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.534443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b6ff2993-366a-44e3-a087-9a424b286f32 req-2d1dc2bb-c1e6-4d06-a9b2-7e0b2afd692b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.547958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-b6ff2993-366a-44e3-a087-9a424b286f32 req-2d1dc2bb-c1e6-4d06-a9b2-7e0b2afd692b service nova] Creating event network-vif-plugged:2dc30772-ddee-4ca5-83be-e3d8cf74b4d0 for instance 78760983-818c-49f0-b03d-099deb32c0b9 on hv-cinder-85394 Aug 22 11:06:12.553265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-b6ff2993-366a-44e3-a087-9a424b286f32 req-2d1dc2bb-c1e6-4d06-a9b2-7e0b2afd692b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033943 Aug 22 11:06:12.554098 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 130/259] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:12.657314 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:12.660010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:12.666049 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.667359 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.667796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.668507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:12.669304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:12.670457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:12.735667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:12.744751 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bdcc740d-540f-4d23-839b-b2c644426e8b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1184 microversion: 2.1 time: 0.094560 Aug 22 11:06:12.745312 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 130/260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:12 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1184 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:12.848250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1397917767", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "166e6798-7b1d-482e-a524-1940d4c8d177"}], "security_groups": [{"name": "tempest-securitygroup--157042232"}], "key_name": "tempest-keypair-1137023031", "user_data": "}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:13.038668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] validate_networks() for [('166e6798-7b1d-482e-a524-1940d4c8d177', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:06:13.144996 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:13.145628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:13.153879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.154725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.155383 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.157469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.158050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.159053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.437544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.446689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-85bed6c2-a0a2-4711-9fc5-54b531edd721 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1516 microversion: 2.1 time: 0.305814 Aug 22 11:06:13.447496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 131/261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:13 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:13.452195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:13.452794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:13.458851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.459572 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.460208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.461066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.462451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.463042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.488907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:06:13.489621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:06:13.490783 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:06:13.492394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:06:13.496041 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:06:13.504483 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.504965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.505397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.506729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.507181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.507605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.525957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:06:13.530247 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:06:13.541975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:06:13.544512 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:06:13.627218 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.635566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e7d3508d-d071-4e7c-b7ce-46414d7d9651 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.186979 Aug 22 11:06:13.636124 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 132/262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:13 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:13.640626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:13.641217 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:13.646950 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.647443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.647735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.648418 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.648870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.649299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.702089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7202fe3d-84cb-4ebc-bc8f-15e90e469864 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.858959 Aug 22 11:06:13.703305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 131/263] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:06:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:06:13.714994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5644d130-a44f-4c62-8516-ca3b56653a95 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:13.715604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5644d130-a44f-4c62-8516-ca3b56653a95 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:13.777007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5644d130-a44f-4c62-8516-ca3b56653a95 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.784876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5644d130-a44f-4c62-8516-ca3b56653a95 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1242 microversion: 2.1 time: 0.073701 Aug 22 11:06:13.785810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 132/264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:13 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:13.790686 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:13.791314 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:13.797453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.797934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.798435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.799275 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:13.799727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:13.800139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:13.876277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.887388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-54a05bd3-b243-42ca-85c4-74a4c950f69a tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1202 microversion: 2.1 time: 0.100374 Aug 22 11:06:13.887979 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 133/265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:13 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:13.933152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.941986 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.944160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:13.945551 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bdd77e55-a2a4-44eb-acb1-878f9309b704 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.308511 Aug 22 11:06:13.946116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 133/266] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:13 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:14.659903 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:14.660983 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:14.674643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.675472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.676171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.678974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.679710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.680369 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.810266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:14.810796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:14.817128 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.817854 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.818395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.819108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.819844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.820273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.916392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:14.920302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:14.927533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-643638b5-a05d-4d05-8356-ecf6c910dbfe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1246 microversion: 2.1 time: 0.121117 Aug 22 11:06:14.929730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 134/267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:14 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:14.932817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6882d6ab-64f9-4e42-a728-dc8b0c7d5f75 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1314 microversion: 2.1 time: 0.274826 Aug 22 11:06:14.932817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 134/268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:14 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:14.946863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:14.947741 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:14.954958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.955452 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.960744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.960744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.960744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.960744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.971321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:14.972235 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:14.985433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.986132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.988698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:14.988698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:14.988698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:14.988698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:15.130070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:15.138944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ce71a3f8-44c0-4679-aff4-690ab0f40af7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1270 microversion: 2.1 time: 0.206946 Aug 22 11:06:15.141477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 135/269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:14 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:15.217506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:15.228648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:15.230288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:15.231583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f5f0cee-ee41-41de-a38e-1149d956152a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.264934 Aug 22 11:06:15.232499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 135/270] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:14 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:15.289942 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-527fd10a-8b2f-48c5-ad05-3ed1060ed894 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'create', calling method: .version_select at 0x7f3b4cb4d4c0>, body: {"keypair": {"name": "tempest-keypair-2057763902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwwL6gE2Mx3dQWKL3Vj7o0EUmpG019QMhPYGpz9w7g5w0HVhvpMkdnKvIy0Cb/4iM0FwtRcZK16WfVbZePDiVEB8m6DFwwWxm0r/ENLITg/J1s28d8cIP+19zp00lyVjg=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:15.306627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-527fd10a-8b2f-48c5-ad05-3ed1060ed894 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:06:15.310651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-527fd10a-8b2f-48c5-ad05-3ed1060ed894 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for user 7c6fee0b956e41a7b2d9b914043633ea and project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:06:15.414970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-527fd10a-8b2f-48c5-ad05-3ed1060ed894 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129437 Aug 22 11:06:15.416520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 136/271] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:06:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:15.657199 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-7d219b05-8a1c-46b0-98ac-893d5df57d68 req-7b4dc4ba-89da-4949-9c97-7d0bfb94be38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:15.667085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7d219b05-8a1c-46b0-98ac-893d5df57d68 req-7b4dc4ba-89da-4949-9c97-7d0bfb94be38 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:15.667548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7d219b05-8a1c-46b0-98ac-893d5df57d68 req-7b4dc4ba-89da-4949-9c97-7d0bfb94be38 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:15.667965 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-7d219b05-8a1c-46b0-98ac-893d5df57d68 req-7b4dc4ba-89da-4949-9c97-7d0bfb94be38 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:15.679672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-7d219b05-8a1c-46b0-98ac-893d5df57d68 req-7b4dc4ba-89da-4949-9c97-7d0bfb94be38 service nova] Creating event network-changed:2240a687-7199-4dd1-8568-213265e08ae1 for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 on hv-cinder-85394 Aug 22 11:06:15.685242 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-7d219b05-8a1c-46b0-98ac-893d5df57d68 req-7b4dc4ba-89da-4949-9c97-7d0bfb94be38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031235 Aug 22 11:06:15.685687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 136/272] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:15.951816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:15.953139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:15.953322 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:15.954072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:15.961431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:15.962111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:15.962866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:15.963752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:15.964435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:15.965027 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:15.981806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:15.982896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:15.984229 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:15.984970 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:15.985434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:15.985855 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:16.054674 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:16.064391 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c0157898-5e23-4c90-922a-fb615a980d80 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1294 microversion: 2.1 time: 0.117291 Aug 22 11:06:16.065121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 137/273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:15 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:16.173443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:16.179103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:16.194596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:16.198647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:16.198647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:16.198647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:16.198647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:16.199368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:16.261310 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:16.280013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-53960134-f6d7-4c55-978e-6248714ec1af tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1498 microversion: 2.1 time: 0.330653 Aug 22 11:06:16.281773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 137/274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:15 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:16.288715 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:16.290281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:16.305708 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:16.308952 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:16.309827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:16.322296 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:16.322899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:16.323340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:16.480329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:16.488806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-024b75c3-f3f5-4b74-8842-25c75a1b3058 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.328198 Aug 22 11:06:16.489407 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 138/275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:16 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:16.518542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:16.524192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:16.525685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:16.526909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9ea2b2aa-cef7-4e05-b027-667099442f69 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.242723 Aug 22 11:06:16.527462 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 138/276] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:16 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:17.086731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:17.087380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:17.094357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.094827 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.095423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.096395 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.096853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.097272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.175289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:17.184913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-97ce4c77-f5c1-495f-b39d-1d4451ba32f5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1300 microversion: 2.1 time: 0.102308 Aug 22 11:06:17.188954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 139/277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:17 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:17.266565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:17.267125 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:17.274427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.274915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.275338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.276042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.276522 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.276893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.312625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:06:17.511258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:17.511996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:17.518917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.519687 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.520337 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.521327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.522274 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.522940 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.659521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c5ab7c6e-ba90-4956-ab22-572243dfddea tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 204 len: 0 microversion: 2.1 time: 0.395314 Aug 22 11:06:17.660973 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 139/278] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:06:17 2022] DELETE /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:06:17.669114 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:17.669739 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:17.676234 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.676918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.677538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.678588 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.679305 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.679853 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.808352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:17.816768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8c9e10f3-7608-4a84-8388-a41d6458b3c5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.309719 Aug 22 11:06:17.829941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 140/279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:17 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:17.835038 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:17.838477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:17.845852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.846498 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.847148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.847956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:17.849148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:17.850330 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:17.930044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:17.939098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:17.940626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:17.941947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-be1c0fd6-a363-4585-9719-389542a0e6a4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.278274 Aug 22 11:06:17.942541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 140/280] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:17 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:18.079089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:18.089887 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7e9c8422-d9df-4a02-994e-f5c9e8d29346 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1504 microversion: 2.1 time: 0.258457 Aug 22 11:06:18.102378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 141/281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:17 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:18.206688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:18.207302 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:18.209492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:18.214343 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:18.214830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:18.215272 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:18.216217 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:18.216731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:18.217159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:18.219778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:18.441334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:18.448149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58a0e3b5-4816-45ba-a824-55e1a2471c5f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.245281 Aug 22 11:06:18.448984 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 141/282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:18 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:18.570260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1007952527", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b914a658-1e38-4bf2-b0cc-742447239f97"}], "security_groups": [{"name": "tempest-securitygroup--52482393"}], "key_name": "tempest-keypair-2057763902", "user_data": "}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:18.595236 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-6c795e7b-1b35-4afa-bb43-fdf81a7209e4 req-0daad835-858d-46d3-947e-b730b090df77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b9e6d6-e6f5-46d0-8304-e309558d2819", "tag": "46c50266-ff83-4fdd-99f6-28c11d2f2a91"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:18.606512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6c795e7b-1b35-4afa-bb43-fdf81a7209e4 req-0daad835-858d-46d3-947e-b730b090df77 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:18.608052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6c795e7b-1b35-4afa-bb43-fdf81a7209e4 req-0daad835-858d-46d3-947e-b730b090df77 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:18.608781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6c795e7b-1b35-4afa-bb43-fdf81a7209e4 req-0daad835-858d-46d3-947e-b730b090df77 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:18.622459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-6c795e7b-1b35-4afa-bb43-fdf81a7209e4 req-0daad835-858d-46d3-947e-b730b090df77 service nova] Creating event network-changed:46c50266-ff83-4fdd-99f6-28c11d2f2a91 for instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 on hv-cinder-85394 Aug 22 11:06:18.627124 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-6c795e7b-1b35-4afa-bb43-fdf81a7209e4 req-0daad835-858d-46d3-947e-b730b090df77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036139 Aug 22 11:06:18.627876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 142/283] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:18.687995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] validate_networks() for [('b914a658-1e38-4bf2-b0cc-742447239f97', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:06:18.845138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:18.846621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:18.855139 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:18.855836 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:18.856844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:18.858073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:18.858431 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:18.859048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.007615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.016338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1bc46513-f706-418c-9bf0-f78a0fcc4246 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.181481 Aug 22 11:06:19.018377 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 143/284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:18 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:19.035231 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:19.035845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:19.042874 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.043390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.043832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.044554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.045148 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.045580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.134040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:06:19.135041 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:06:19.135711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:06:19.136460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:06:19.137316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:06:19.149483 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.149483 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.149922 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.150724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.151115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.151599 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.170292 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:06:19.175162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Getting quotas for user 7c6fee0b956e41a7b2d9b914043633ea and project 2cb7651353884366b2ca72a7e272bdc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:06:19.195974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:06:19.200815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:06:19.219722 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.229678 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.232722 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.235420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-610f39a5-b0a8-4692-8db9-742745169543 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.216009 Aug 22 11:06:19.239294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 144/285] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:19 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:19.241829 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:19.242611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:19.249563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.250727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.251344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.252042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.252492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.252915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.335337 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5708ca7a-019e-464d-8b1f-bdfbb0a6d0a1 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.769955 Aug 22 11:06:19.337976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 142/286] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:06:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:06:19.353549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1584ce01-f19e-4607-9cca-627ba9863624 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:19.355154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1584ce01-f19e-4607-9cca-627ba9863624 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:19.453942 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.465137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1584ce01-f19e-4607-9cca-627ba9863624 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.467349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0c67abba-8312-490a-a25f-d6bff385800a tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1504 microversion: 2.1 time: 0.229749 Aug 22 11:06:19.468005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 145/287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:19 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:19.483754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1584ce01-f19e-4607-9cca-627ba9863624 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1246 microversion: 2.1 time: 0.138506 Aug 22 11:06:19.484329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 143/288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:19 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1246 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:19.485731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:19.486376 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:19.492721 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.493203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.493683 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.494440 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:19.494897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:19.495474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:19.643373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:19.651061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0d7b2870-b67a-456d-8d33-396c829fd2a7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.182011 Aug 22 11:06:19.651718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 146/289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:19 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:20.040844 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:20.041461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:20.049346 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.052181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.054141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.055318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.057758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.059450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.259857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:20.260490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:20.262748 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:20.263401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=8 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:20.268455 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.268941 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.269376 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.270071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.270543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.271540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.321904 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.331422 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-45fbbd8b-8966-4150-9d1a-bb0b33e2abb7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.295669 Aug 22 11:06:20.339987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 144/290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:20 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:20.457730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-87d9388c-c511-4d0e-91f1-33cc837efa94 req-4ccf83c5-2083-478a-864b-db46a6b2f78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78760983-818c-49f0-b03d-099deb32c0b9", "name": "network-vif-deleted", "tag": "2dc30772-ddee-4ca5-83be-e3d8cf74b4d0"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:20.469496 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-87d9388c-c511-4d0e-91f1-33cc837efa94 req-4ccf83c5-2083-478a-864b-db46a6b2f78b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.470388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-87d9388c-c511-4d0e-91f1-33cc837efa94 req-4ccf83c5-2083-478a-864b-db46a6b2f78b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.471050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-87d9388c-c511-4d0e-91f1-33cc837efa94 req-4ccf83c5-2083-478a-864b-db46a6b2f78b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.485597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-87d9388c-c511-4d0e-91f1-33cc837efa94 req-4ccf83c5-2083-478a-864b-db46a6b2f78b service nova] Creating event network-vif-deleted:2dc30772-ddee-4ca5-83be-e3d8cf74b4d0 for instance 78760983-818c-49f0-b03d-099deb32c0b9 on hv-cinder-85394 Aug 22 11:06:20.492413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-87d9388c-c511-4d0e-91f1-33cc837efa94 req-4ccf83c5-2083-478a-864b-db46a6b2f78b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038204 Aug 22 11:06:20.494096 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 145/291] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:06:20.500872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:20.501581 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:20.509864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.510718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.511364 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.512345 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.513203 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.514356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.516256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.526489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.527993 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.529158 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bbdc8a81-2656-412c-924e-c2ce0f050789 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1744 microversion: 2.20 time: 0.273694 Aug 22 11:06:20.531803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 147/292] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:20 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1744 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:20.534595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:20.536549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:20.537770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:20.545228 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.546042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.546809 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.547734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.548541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.549174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.639448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.652090 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cdc22230-8a4c-49e9-8e6e-828bbdb6c334 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1250 microversion: 2.1 time: 0.119210 Aug 22 11:06:20.653156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 148/293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:20 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1250 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:20.654491 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.668338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1553849c-d14c-4c41-8ea0-b84c40c5a6ca tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1462 microversion: 2.1 time: 0.173059 Aug 22 11:06:20.678100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 146/294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:20 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1462 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:20.678295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:20.678295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:20.680885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.681379 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.681899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.682611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:20.683068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:20.683484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:20.889262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:20.899170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-64643ba9-048c-4ed6-9bd3-56d63ef02592 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.230808 Aug 22 11:06:20.900044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 149/295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:20 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:21.352332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:21.352933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:21.360017 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.360498 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.360929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.361619 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.362070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.362513 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.498354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:21.507014 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1d3a32ea-4214-4351-bf30-e60f46809c03 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.158981 Aug 22 11:06:21.511307 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:21 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:21.559605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:21.560243 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:21.566842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.567323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.568336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.569049 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.569508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.569934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.675554 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:21.676158 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:21.684147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.684626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.685052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.685953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.686595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.687067 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.706649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:21.715691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:21.717279 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:21.718463 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b29fb674-7c93-4270-ba26-2ca53b25c9cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1744 microversion: 2.20 time: 0.162862 Aug 22 11:06:21.719024 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 150/297] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:21 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:21.723461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:21.724073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:21.730547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.731023 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.731621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.732311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.733018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.733577 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.754645 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:21.762779 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-61fc3f50-a632-4156-8963-983582591e7e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1298 microversion: 2.1 time: 0.092837 Aug 22 11:06:21.763354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 148/298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:21 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:21.770494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.771733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.772180 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.772633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lazy-loading 'fault' on Instance uuid 78760983-818c-49f0-b03d-099deb32c0b9 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:06:21.817728 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d3e938eea5476991577dab405323ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292c489810ff42a5a7adbb7e7c251514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:21.825927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-02df9d5b-6a36-4188-a387-4278e11f7bd3 tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 200 len: 1304 microversion: 2.1 time: 0.105869 Aug 22 11:06:21.826534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 151/299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:21 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:21.922369 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:21.922975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:21.929233 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.929736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.930166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:21.930960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:21.931407 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:21.935164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.069274 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:22.077562 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3ea33c23-fbc9-419b-a695-9d298a52fd2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.158998 Aug 22 11:06:22.078206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 149/300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:21 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:22.530458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:22.531071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:22.537080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:22.542138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:22.542138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.542138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:22.542138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:22.542494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.744486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:22.750798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:22.757281 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:22.758371 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:22.759140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.760365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:22.761161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:22.761910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.945713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:22.953474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-05889572-e69e-4c8d-8bf8-126860ca5086 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.426864 Aug 22 11:06:22.954274 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 152/301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:22 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:22.972225 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:22.972836 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:22.978681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:22.978936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:22.979323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:22.979755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.980445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:22.981032 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:22.981656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:22.988412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:22.990984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:22.991470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7f304030-7abb-415d-8942-7467c5b6df4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1744 microversion: 2.20 time: 0.252532 Aug 22 11:06:22.992026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 150/302] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:22 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1744 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:22.996570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:22.997171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] [instance: 78760983-818c-49f0-b03d-099deb32c0b9] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:23.002998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:23.003484 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:23.004045 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:23.004602 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:23.005051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:23.006004 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:23.019749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] HTTP exception thrown: Instance 78760983-818c-49f0-b03d-099deb32c0b9 could not be found. Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Request method failure captured: Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 HTTP/1.1 Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2L-PvlVsKVgxmGgcmfPPgBp1vXFPkT-iSCLm2DcYyhgVd0nazw7fBJHJFePXPeGW9rep63m2sqK5-H0F1kN2lgYDk79sLLZ8DLDS2QRXGVkZ6HuPl0bufaEF3EsZe2OtaOC_868B798FhTyCv4vDLCUAbyMPibJMLYvK1FPzYxPLDg Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 292c489810ff42a5a7adbb7e7c251514 Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-VolumesActionsTest-307717966 Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:06:23.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/292c489810ff42a5a7adbb7e7c251514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/292c489810ff42a5a7adbb7e7c251514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_292c489810ff42a5a7adbb7e7c251514", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/292c489810ff42a5a7adbb7e7c251514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-VolumesActionsTest-307717966 Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 292c489810ff42a5a7adbb7e7c251514 Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-VolumesActionsTest-307717966 Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-VolumesActionsTest-307717966-project Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: e8d3e938eea5476991577dab405323ee Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-VolumesActionsTest-307717966-project Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 78760983-818c-49f0-b03d-099deb32c0b9 could not be found. Aug 22 11:06:23.025872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '78760983-818c-49f0-b03d-099deb32c0b9'} Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78760983-818c-49f0-b03d-099deb32c0b9 could not be found. Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:06:23.026995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78760983-818c-49f0-b03d-099deb32c0b9 could not be found. Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78760983-818c-49f0-b03d-099deb32c0b9 could not be found. Aug 22 11:06:23.028350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:06:23.029539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] Returning 404 to user: Instance 78760983-818c-49f0-b03d-099deb32c0b9 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:06:23.029539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-21cfdc26-7eb3-43b8-b8d6-1aa8d794017e tempest-VolumesActionsTest-307717966 tempest-VolumesActionsTest-307717966-project] 10.222.0.48 "GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9" status: 404 len: 111 microversion: 2.1 time: 0.031279 Aug 22 11:06:23.030081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 151/303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:22 2022] GET /compute/v2.1/servers/78760983-818c-49f0-b03d-099deb32c0b9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:06:23.062185 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:23.070949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d89c6dcb-26a3-4062-aaa9-800581dc8e9a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1298 microversion: 2.1 time: 0.103441 Aug 22 11:06:23.071625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 153/304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:22 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:23.099272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:23.099272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:23.105156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:23.105718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:23.106264 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:23.108586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:23.108586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:23.108586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:23.247045 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:23.268821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bae22261-9f15-49f7-b558-0523ac6342dd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.174634 Aug 22 11:06:23.275712 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 152/305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:23 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:23.975522 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:23.976144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:23.982711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:23.983199 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:23.983847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:23.984778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:23.985245 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:23.985694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.017450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:24.019235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:24.048197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.048683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.049126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.056283 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.059141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.059749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.273373 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:24.288081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:24.291235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:24.293977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7eb82fd3-b6ee-4a1f-8bdf-f49009ee859b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.281603 Aug 22 11:06:24.308084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:24.309617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 153/306] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:24 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:24.319333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:24.320059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:24.322078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd217b87-f9f6-48f2-9cc1-9da59100e045 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.350976 Aug 22 11:06:24.326282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 154/307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:23 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:24.337005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:24.341575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:24.341699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.341699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.341699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.342563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.343298 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.344202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.353877 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.354979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.356610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.357759 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.359359 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.368849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.525998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:24.542353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a7518468-ff3b-4496-b5a4-6dc11b7e3cad tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1316 microversion: 2.1 time: 0.230991 Aug 22 11:06:24.552681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 154/308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:24 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:24.779649 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-427183db-4e15-445c-ace0-2baa3efbe28f req-6ff7e881-a799-42b2-8d28-2a57ca40f1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "name": "network-vif-plugged", "status": "completed", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:24.795631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-427183db-4e15-445c-ace0-2baa3efbe28f req-6ff7e881-a799-42b2-8d28-2a57ca40f1cc service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:24.798694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-427183db-4e15-445c-ace0-2baa3efbe28f req-6ff7e881-a799-42b2-8d28-2a57ca40f1cc service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:24.806738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-427183db-4e15-445c-ace0-2baa3efbe28f req-6ff7e881-a799-42b2-8d28-2a57ca40f1cc service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:24.830302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-427183db-4e15-445c-ace0-2baa3efbe28f req-6ff7e881-a799-42b2-8d28-2a57ca40f1cc service nova] Creating event network-vif-plugged:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:06:24.849099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-427183db-4e15-445c-ace0-2baa3efbe28f req-6ff7e881-a799-42b2-8d28-2a57ca40f1cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073504 Aug 22 11:06:24.852210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 155/309] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:06:24.867614 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:24.876732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ba8f9c41-6606-4d5b-bd09-0af1382fd305 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.550456 Aug 22 11:06:24.883955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 155/310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:24 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:25.325966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:25.328106 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:25.345886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:25.346781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:25.354626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.358922 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.359730 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.360405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.361422 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.361902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.364059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.365041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.365857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.367132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.367851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.370841 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.618302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:25.626865 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:25.627999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:25.629567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:25.631222 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a7de5de3-53e6-49f7-bc1e-e296ebad163f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.313264 Aug 22 11:06:25.632265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 156/311] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:25 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:25.635454 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-98997097-07c9-4cb5-a466-8c63815bfdff tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.293349 Aug 22 11:06:25.637290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:25.650257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 156/312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:25 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:25.650883 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:25.655577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:25.661239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.662503 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.663006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.663965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.664742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.665227 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.833266 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:25.841744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-465462ba-0d3e-4563-a867-0a412d4fc99d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.208085 Aug 22 11:06:25.846877 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 157/313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:25 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:25.905204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:25.906194 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:25.915857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.916757 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.917567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:25.918647 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:25.919519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:25.920146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.106202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:26.106202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9bf79ad2-ab97-4a76-be23-317d77545f45 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.177255 Aug 22 11:06:26.106202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 157/314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:25 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:26.656608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:26.657398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:26.664485 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:26.666613 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:26.667792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:26.668655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:26.669561 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.669964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:26.670475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:26.670902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.672738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:26.673216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:26.674072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.674804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:26.675472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:26.676329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.698704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:26.841323 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:26.852243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:26.853800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:26.856135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-93404b41-7c40-4354-b77b-d146b77517ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.203484 Aug 22 11:06:26.864171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 158/315] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:26 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:26.877659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:26.878709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:26.886884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:26.887367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:26.887799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.888490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:26.891031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:26.895297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:26.925255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:26.936002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1cb567dd-7d42-49b7-8a74-090caec24ac4 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.276278 Aug 22 11:06:26.960103 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:26 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:27.108207 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:27.119105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:27.123065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:27.123312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9d7da3b8-84fb-47fd-af82-7ec379d48b30 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.254428 Aug 22 11:06:27.123312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 159/317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:26 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:27.130711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.131483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.132133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:27.133057 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.133714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.134425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:27.358169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:27.368881 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5371d06e-0fad-415d-8188-0e8e81a817cd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.254168 Aug 22 11:06:27.369592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 159/318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:27 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:27.766639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-a0f80415-16b6-4d6a-91b3-52b3d8e2014e req-d2879a3b-dbd9-4fe4-a50c-e479001c4b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790ba6d2-ada3-468b-bb51-1fca7bc7c349", "tag": "ae8855e3-0bba-4105-b7f6-23b967086d90"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:27.785819 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a0f80415-16b6-4d6a-91b3-52b3d8e2014e req-d2879a3b-dbd9-4fe4-a50c-e479001c4b4a service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.787252 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a0f80415-16b6-4d6a-91b3-52b3d8e2014e req-d2879a3b-dbd9-4fe4-a50c-e479001c4b4a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.788181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a0f80415-16b6-4d6a-91b3-52b3d8e2014e req-d2879a3b-dbd9-4fe4-a50c-e479001c4b4a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:27.811051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-a0f80415-16b6-4d6a-91b3-52b3d8e2014e req-d2879a3b-dbd9-4fe4-a50c-e479001c4b4a service nova] Creating event network-changed:ae8855e3-0bba-4105-b7f6-23b967086d90 for instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 on hv-cinder-85394 Aug 22 11:06:27.840417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-a0f80415-16b6-4d6a-91b3-52b3d8e2014e req-d2879a3b-dbd9-4fe4-a50c-e479001c4b4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069615 Aug 22 11:06:27.840417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 160/319] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:27.880413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:27.882002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:27.891414 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.891903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.892351 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:27.893066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.893524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.893952 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:27.983109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:27.983109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:27.994888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.995384 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.995823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:27.996524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:27.996972 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:27.997390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:28.142709 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:28.152576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:28.154132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:28.155323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c4057823-59d3-4ae7-91fc-0460111a13a6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.279523 Aug 22 11:06:28.171173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 160/320] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:27 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:28.171173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:28.171173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:28.171673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:28.171796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:28.171796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:28.171796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:28.171796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:28.172071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:28.172071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:28.172922 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cfe762c4-3cce-4300-bdf9-0300ccd63967 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.195761 Aug 22 11:06:28.178774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 161/321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:27 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:28.393510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:28.394983 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:28.407723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:28.408228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:28.408726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:28.409500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:28.410422 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:28.410910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:28.455753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:28.465364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-536ac992-5f32-4b47-849a-daa743cf9ca0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.307719 Aug 22 11:06:28.470344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 161/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:28 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:28.618603 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:28.626821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f32306c6-c6dd-467a-8b56-f6403feca1ce tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.238629 Aug 22 11:06:28.630223 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:28 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:29.182105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:29.182868 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:29.190106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.190842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.191357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.192287 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.192919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.193350 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.196176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:29.197398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:29.203934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:29.207165 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.208842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.209504 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.210488 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.211183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.211823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.404549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:29.427018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:29.435684 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-aac7cdb8-4ff4-49f6-85b8-44d009beb8ea tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.243711 Aug 22 11:06:29.436374 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:29.444818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:29.445769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 163/324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:29 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:29.460176 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b57bd283-d076-40b2-8df6-2079d528010f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.269460 Aug 22 11:06:29.466454 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 162/325] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:29 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:29.494094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:29.495481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:29.497831 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=34 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:29.510731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.511497 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.512604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.513401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.513807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.514348 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.650011 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:29.650670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:29.659846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.670422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.671159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.673015 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:29.677982 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:29.680527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:29.838288 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:29.847586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d8a95698-9fc6-44ec-97f3-6efeed3e2714 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.358348 Aug 22 11:06:29.860920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 164/326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:29 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:30.123696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:30.154213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c87ab9a6-f719-4cc4-b4be-bcfad63e1254 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.508496 Aug 22 11:06:30.155660 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 163/327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:29 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:30.471642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:30.472489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:30.476664 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:30.477382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:30.486187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:30.486712 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:30.491711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:30.492226 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:30.492671 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:30.493397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:30.493849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:30.494295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:30.502310 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:30.506768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:30.507390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:30.507845 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:30.515863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:30.778977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:30.792853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7b08c460-e5c9-4cb0-99d4-7f78a27af348 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.327280 Aug 22 11:06:30.794475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 165/328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:30 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:30.800864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-abd38887-8b6d-45cf-acca-5180d6adbbfb req-d4db7e44-3afb-42af-b017-017c291f48e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "name": "network-vif-plugged", "status": "completed", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:30.855498 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-abd38887-8b6d-45cf-acca-5180d6adbbfb req-d4db7e44-3afb-42af-b017-017c291f48e4 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:30.856765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-abd38887-8b6d-45cf-acca-5180d6adbbfb req-d4db7e44-3afb-42af-b017-017c291f48e4 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:30.858116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-abd38887-8b6d-45cf-acca-5180d6adbbfb req-d4db7e44-3afb-42af-b017-017c291f48e4 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:30.914318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-abd38887-8b6d-45cf-acca-5180d6adbbfb req-d4db7e44-3afb-42af-b017-017c291f48e4 service nova] Creating event network-vif-plugged:2240a687-7199-4dd1-8568-213265e08ae1 for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 on hv-cinder-85394 Aug 22 11:06:30.940195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-abd38887-8b6d-45cf-acca-5180d6adbbfb req-d4db7e44-3afb-42af-b017-017c291f48e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143722 Aug 22 11:06:30.953383 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 166/329] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:30.988180 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:31.005586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:31.035234 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:31.038273 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:31.038953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:31.039870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:31.040356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:31.043650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:31.086083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:31.096479 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:31.103759 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:31.108931 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd11b8d6-4573-4dc7-bf1b-6bcf283e6877 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.636478 Aug 22 11:06:31.110343 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 164/330] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:30 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:31.187752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:31.189696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:31.202604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:31.205846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:31.206494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:31.207375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:31.208727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:31.209304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:31.444034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:31.466436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-adf2d864-c6a0-4843-863b-279f0609b01b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.497291 Aug 22 11:06:31.468555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 167/331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:30 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:31.624682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:31.636525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-108dd682-b16a-4b42-be2a-44a6ae0c7242 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.459411 Aug 22 11:06:31.641688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 165/332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:31 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:31.819221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:31.819882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:31.834766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:31.835204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:31.835665 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:31.836399 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:31.836867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:31.837310 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.071727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:32.084244 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4c718b8b-3f4d-4821-ad74-8502674809e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.270730 Aug 22 11:06:32.085754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 168/333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:31 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:32.137958 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:32.138918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:32.152542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:32.153229 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:32.164542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.164542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:32.164542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:32.164542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.359831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:32.378092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:32.380286 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:32.381574 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e78c33cd-00dc-4b2b-bb3b-09cb3271ebbb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.250268 Aug 22 11:06:32.386270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 166/334] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:32 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:32.494196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:32.495123 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:32.508331 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:32.508953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:32.509608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.511207 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:32.511775 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:32.512270 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.668209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:32.670535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:32.695202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:32.703282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:32.703894 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:32.706885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.710261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:32.710847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:32.711521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-03c800f7-529a-4a5a-8380-2d4755cc38f2 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.221305 Aug 22 11:06:32.712615 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 169/335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:32 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:32.714461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:32.972521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:32.984789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8e29a6a6-d288-4954-aa4e-a3e4a05307a2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.318236 Aug 22 11:06:32.984789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 167/336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:32 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:33.107597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:33.108881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:33.135693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.137145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.137776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:33.138717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.139329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.139925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:33.183522 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-75d24a1e-7fc9-41b9-bd10-b654c828813c req-9d26ec2e-0792-42cb-bbcc-f3387a71379d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b9e6d6-e6f5-46d0-8304-e309558d2819", "name": "network-vif-plugged", "status": "completed", "tag": "46c50266-ff83-4fdd-99f6-28c11d2f2a91"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:33.225465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-75d24a1e-7fc9-41b9-bd10-b654c828813c req-9d26ec2e-0792-42cb-bbcc-f3387a71379d service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.226292 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-75d24a1e-7fc9-41b9-bd10-b654c828813c req-9d26ec2e-0792-42cb-bbcc-f3387a71379d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.226877 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-75d24a1e-7fc9-41b9-bd10-b654c828813c req-9d26ec2e-0792-42cb-bbcc-f3387a71379d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:33.252193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-75d24a1e-7fc9-41b9-bd10-b654c828813c req-9d26ec2e-0792-42cb-bbcc-f3387a71379d service nova] Creating event network-vif-plugged:46c50266-ff83-4fdd-99f6-28c11d2f2a91 for instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 on hv-cinder-85394 Aug 22 11:06:33.266659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-75d24a1e-7fc9-41b9-bd10-b654c828813c req-9d26ec2e-0792-42cb-bbcc-f3387a71379d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088366 Aug 22 11:06:33.268205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 168/337] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:33.377917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:33.388031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-29977779-b4b3-4044-8e63-1ee462446d49 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1258 microversion: 2.1 time: 0.285569 Aug 22 11:06:33.389593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 170/338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:33 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1258 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:33.425134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:33.425854 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:33.449418 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.449943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.450432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:33.455110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.466638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.466638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:33.662773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:33.682274 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:33.683361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:33.684470 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fc5508a9-0dae-4ad4-8051-cd41cfb71738 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.282070 Aug 22 11:06:33.686297 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 169/339] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:33 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:33.734255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:33.735139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:33.743689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.745082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.747048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:33.748391 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:33.749194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:33.750240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.013508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:34.016339 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:34.049714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.052156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.057835 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.059473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.064109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.066529 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.077657 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:34.085723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fea8860d-b56d-4e2d-8d07-88fe9fc96d1b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.355909 Aug 22 11:06:34.088598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 171/340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:33 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:34.390907 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:34.413127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9308e9fd-e305-4ed8-b254-4a4bf77d6367 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.409965 Aug 22 11:06:34.414578 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 170/341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:34 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:34.415614 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:34.416784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:34.434591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.436692 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.438879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.439965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.440596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.441204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.650347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:34.660307 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-89963654-c1eb-43a8-a75e-f5020f6d79ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1443 microversion: 2.1 time: 0.249207 Aug 22 11:06:34.662292 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 172/342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:34 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1443 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:06:34.683291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:34.688887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:34.704779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.705520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.706110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.707006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.707804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.709778 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:34.710428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:34.710612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.724548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.725062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.727130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.729140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:34.730739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:34.731258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:34.993652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:35.004815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:35.006634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:35.008015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0e1bc7b0-13f8-4fc1-859e-e54a512a6390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.303440 Aug 22 11:06:35.024025 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 173/343] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:34 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:35.042393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:35.057560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1f72d54f-ac69-487a-9df2-0b8589285e54 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1443 microversion: 2.1 time: 0.376797 Aug 22 11:06:35.064013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 171/344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:34 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1443 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:35.109868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:35.111005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:35.120145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:35.121682 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:35.122477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:35.126074 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:35.127623 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:35.128610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:35.327644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-c65afcc7-dda2-4c5a-b74e-b71c4e233195 req-dc31fc90-5832-4233-9374-977ab625debf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790ba6d2-ada3-468b-bb51-1fca7bc7c349", "name": "network-vif-plugged", "status": "completed", "tag": "ae8855e3-0bba-4105-b7f6-23b967086d90"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:35.354179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c65afcc7-dda2-4c5a-b74e-b71c4e233195 req-dc31fc90-5832-4233-9374-977ab625debf service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:35.354996 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c65afcc7-dda2-4c5a-b74e-b71c4e233195 req-dc31fc90-5832-4233-9374-977ab625debf service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:35.355608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c65afcc7-dda2-4c5a-b74e-b71c4e233195 req-dc31fc90-5832-4233-9374-977ab625debf service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:35.387422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-c65afcc7-dda2-4c5a-b74e-b71c4e233195 req-dc31fc90-5832-4233-9374-977ab625debf service nova] Creating event network-vif-plugged:ae8855e3-0bba-4105-b7f6-23b967086d90 for instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 on hv-cinder-85394 Aug 22 11:06:35.402559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-c65afcc7-dda2-4c5a-b74e-b71c4e233195 req-dc31fc90-5832-4233-9374-977ab625debf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083776 Aug 22 11:06:35.408791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 172/345] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:35.449188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:35.460087 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:35.480673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:35.482298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:35.484822 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:35.485567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:35.491697 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:35.491697 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:35.513126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:35.529878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3ff98894-632f-4f99-aaa2-e7c89c4fab4d tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.424208 Aug 22 11:06:35.531185 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 174/346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:35 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:35.826438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:35.856375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eb662e59-6ffc-4d02-a5c4-8e033a8d78d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.415765 Aug 22 11:06:35.863196 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 173/347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:35 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:36.037113 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:36.038100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:36.072106 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:36.072539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:36.072975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:36.073688 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:36.074143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:36.087294 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:36.557305 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:36.558210 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:36.610722 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:36.614446 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:36.616793 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:36.617730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:36.618370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:36.620986 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:37.015350 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:37.036462 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f2ae0e5f-22ee-4cfa-8bb8-14854f979bcd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.484772 Aug 22 11:06:37.038814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 174/348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:36 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:37.059677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:37.061962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:37.071736 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:37.077266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:37.077266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:37.077266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:37.077266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:37.077648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:37.402271 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:37.423847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f4f6a2a5-4239-4b20-b7f0-9f7f3cc5f43a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.380633 Aug 22 11:06:37.428435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 175/349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:37 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:37.557818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:37.578677 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:37.580679 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:37.582882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f88d0131-d60f-480b-bbf7-014f07693492 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 1.552335 Aug 22 11:06:37.583752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 175/350] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:36 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:38.080291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:38.080291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:38.080291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:38.080291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:38.080971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:38.080971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:38.080971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:38.081175 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:38.085213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:38.234965 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:38.243029 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c650bffd-21b9-4867-8033-6b41f195e9bd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.183938 Aug 22 11:06:38.243597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 176/351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:38 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:38.448742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:38.448961 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:38.455738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:38.456304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:38.456955 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:38.457853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:38.458398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:38.458902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:38.611732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:38.612557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:38.632119 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:38.644080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:38.645467 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:38.647174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:38.647813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:38.649063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:38.944037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:38.952857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:38.956361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:38.957763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-55837d7a-d7a4-4434-a5c2-246b03ce4390 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.352530 Aug 22 11:06:38.971669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 177/352] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:38 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:38.995195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:39.018996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f05f6735-0cc2-4ac5-98ab-ac2175693874 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1367 microversion: 2.1 time: 0.574259 Aug 22 11:06:39.019361 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 176/353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:38 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:39.295330 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:39.297686 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:39.326177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:39.328644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:39.330540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:39.331391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:39.335033 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:39.335783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:39.647971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:39.660774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6ce94cb8-f1c9-4789-82ff-9fb1a4969ba0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.377855 Aug 22 11:06:39.662014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 178/354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:39 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:39.990913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:39.993168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:40.010437 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.010437 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.010437 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.011394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.012444 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.013068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.014110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-216b76c1-bd67-45ed-a6a7-2da6394ba4d0 req-dbd31f0a-e56f-4fed-bbe4-36f0cbb23f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:40.025541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-216b76c1-bd67-45ed-a6a7-2da6394ba4d0 req-dbd31f0a-e56f-4fed-bbe4-36f0cbb23f26 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.026358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-216b76c1-bd67-45ed-a6a7-2da6394ba4d0 req-dbd31f0a-e56f-4fed-bbe4-36f0cbb23f26 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.026862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-216b76c1-bd67-45ed-a6a7-2da6394ba4d0 req-dbd31f0a-e56f-4fed-bbe4-36f0cbb23f26 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.057132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-216b76c1-bd67-45ed-a6a7-2da6394ba4d0 req-dbd31f0a-e56f-4fed-bbe4-36f0cbb23f26 service nova] Creating event network-changed:2240a687-7199-4dd1-8568-213265e08ae1 for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 on hv-cinder-85394 Aug 22 11:06:40.062851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-216b76c1-bd67-45ed-a6a7-2da6394ba4d0 req-dbd31f0a-e56f-4fed-bbe4-36f0cbb23f26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052964 Aug 22 11:06:40.063539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 179/355] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:06:40.117138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:40.117774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:40.132802 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.135038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.135491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.138284 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.138755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.140617 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.337745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:40.351273 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:40.358029 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:40.358900 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d9f28332-5c56-4fb5-a42f-a9ac1fd4fbe6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1739 microversion: 2.20 time: 0.373892 Aug 22 11:06:40.375164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 177/356] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:39 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1739 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:40.427072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:40.438592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c8c110cf-d35f-4121-8add-221b0af57871 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1557 microversion: 2.1 time: 0.336240 Aug 22 11:06:40.440795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 180/357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:40 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1557 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:40.462297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:40.462794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:40.470582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.472040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.472804 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.473910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.474506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.475013 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.568216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7dcd7a72-7ed6-466f-9d26-8afcba92664d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110612 Aug 22 11:06:40.569352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 178/358] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:06:40 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:40.682434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:40.683337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:40.693604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.696656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.697386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:40.699983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:40.701312 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:40.702076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:41.368459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:41.377809 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a5d62c78-8da0-4487-b857-2722ceb3af37 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1370 microversion: 2.1 time: 0.699518 Aug 22 11:06:41.387068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:41.388221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:41.399058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:41.399782 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:41.400434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 181/359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:40 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1370 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:41.401080 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:41.401806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:41.402312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:41.402711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:41.643182 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:41.653773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:41.655923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:41.657354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-03d30612-d7f2-4c26-b536-19fed5255bec tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1721 microversion: 2.20 time: 0.274258 Aug 22 11:06:41.658606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 179/360] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:41 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:42.408644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:42.411811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:42.426534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.427029 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.427467 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:42.428408 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.429142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.429580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:42.684770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:42.685406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:42.701923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.702715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.704332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:42.704332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.704516 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.704853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:42.770832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:42.788163 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-94018038-6f01-451b-ac95-bbfe0faf33f4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1565 microversion: 2.1 time: 0.387710 Aug 22 11:06:42.788702 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 182/361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:06:42 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1565 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:06:42.811361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:42.811858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:42.818430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.818928 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.819615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:42.820330 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.824642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.824642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:42.957397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aef684a2-4563-4820-b3e7-5b8557a289f7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149355 Aug 22 11:06:42.958014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 183/362] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:06:42 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:06:42.968956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-bf0d111a-c9f0-42af-b28a-e00737783e5c req-3bfcef1c-ce98-47ac-a40a-15339432cd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b9e6d6-e6f5-46d0-8304-e309558d2819", "tag": "46c50266-ff83-4fdd-99f6-28c11d2f2a91"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:42.990763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-bf0d111a-c9f0-42af-b28a-e00737783e5c req-3bfcef1c-ce98-47ac-a40a-15339432cd32 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:42.991633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-bf0d111a-c9f0-42af-b28a-e00737783e5c req-3bfcef1c-ce98-47ac-a40a-15339432cd32 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:42.997302 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-bf0d111a-c9f0-42af-b28a-e00737783e5c req-3bfcef1c-ce98-47ac-a40a-15339432cd32 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:43.013251 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-bf0d111a-c9f0-42af-b28a-e00737783e5c req-3bfcef1c-ce98-47ac-a40a-15339432cd32 service nova] Creating event network-changed:46c50266-ff83-4fdd-99f6-28c11d2f2a91 for instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 on hv-cinder-85394 Aug 22 11:06:43.020135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-bf0d111a-c9f0-42af-b28a-e00737783e5c req-3bfcef1c-ce98-47ac-a40a-15339432cd32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057051 Aug 22 11:06:43.022536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 184/363] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:43.043548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:43.058320 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:43.059827 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:43.067765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-656c679c-ed52-41d1-8cd3-763d85f21d16 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1721 microversion: 2.20 time: 0.386905 Aug 22 11:06:43.068348 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 180/364] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:42 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:44.093501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:44.094262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:44.106293 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:44.107044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:44.109655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:44.112229 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:44.114277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:44.114951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:44.442946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-5125acc1-7e34-47ac-99cd-e1f61eeda6dd req-6ad4e209-ffd7-4b64-933e-51ecb257611f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "name": "network-vif-unplugged", "status": "completed", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:44.471688 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-5125acc1-7e34-47ac-99cd-e1f61eeda6dd req-6ad4e209-ffd7-4b64-933e-51ecb257611f service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:44.476316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-5125acc1-7e34-47ac-99cd-e1f61eeda6dd req-6ad4e209-ffd7-4b64-933e-51ecb257611f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:44.476316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-5125acc1-7e34-47ac-99cd-e1f61eeda6dd req-6ad4e209-ffd7-4b64-933e-51ecb257611f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:44.487708 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:44.493194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-5125acc1-7e34-47ac-99cd-e1f61eeda6dd req-6ad4e209-ffd7-4b64-933e-51ecb257611f service nova] Creating event network-vif-unplugged:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:06:44.505810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-5125acc1-7e34-47ac-99cd-e1f61eeda6dd req-6ad4e209-ffd7-4b64-933e-51ecb257611f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064186 Aug 22 11:06:44.505810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 181/365] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:06:44.505977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:44.508304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:44.514766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e715407e-3f7f-4e53-9b6b-2ddc2e1acbf0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1721 microversion: 2.20 time: 0.425322 Aug 22 11:06:44.516747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 185/366] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:44 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:45.049904 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-18e987fe-ea84-472f-ad3f-5e62cbedbc30 req-65efb802-4ea6-4ea9-9ce5-8d329bd71e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790ba6d2-ada3-468b-bb51-1fca7bc7c349", "tag": "ae8855e3-0bba-4105-b7f6-23b967086d90"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:45.063071 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-18e987fe-ea84-472f-ad3f-5e62cbedbc30 req-65efb802-4ea6-4ea9-9ce5-8d329bd71e68 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:45.064024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-18e987fe-ea84-472f-ad3f-5e62cbedbc30 req-65efb802-4ea6-4ea9-9ce5-8d329bd71e68 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:45.064693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-18e987fe-ea84-472f-ad3f-5e62cbedbc30 req-65efb802-4ea6-4ea9-9ce5-8d329bd71e68 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:45.082726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-18e987fe-ea84-472f-ad3f-5e62cbedbc30 req-65efb802-4ea6-4ea9-9ce5-8d329bd71e68 service nova] Creating event network-changed:ae8855e3-0bba-4105-b7f6-23b967086d90 for instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 on hv-cinder-85394 Aug 22 11:06:45.088742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-18e987fe-ea84-472f-ad3f-5e62cbedbc30 req-65efb802-4ea6-4ea9-9ce5-8d329bd71e68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050959 Aug 22 11:06:45.090011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 182/367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:06:45.540892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:45.543592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:45.566810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:45.567405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:45.581978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:45.586335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:45.586335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:45.586335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:45.868982 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:45.878247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:45.879963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:45.881191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d9d7fdb2-8451-43e4-915c-aa5ce98c5e81 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1724 microversion: 2.20 time: 0.344517 Aug 22 11:06:45.901437 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 186/368] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:45 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:45.904769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5365a963-b320-4048-931b-e306c3951c7c"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:45.907960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:45.919327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:45.920231 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:45.920903 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:45.921845 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:45.922401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:45.922893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:46.069616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:47.055835 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4f753917-6e27-4a98-9308-501b991f9ec2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.155197 Aug 22 11:06:47.056464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 183/369] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 22 11:06:45 2022] POST /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments => generated 188 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:06:47.201836 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:06:47.202636 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:47.210170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:47.210702 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:47.211142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:47.211844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:47.212306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:47.212731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:47.259133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121142) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 11:06:47.272022 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:47.531781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-700c5d44-1c08-4f62-b3c7-ccffdacb37f0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/action" status: 202 len: 0 microversion: 2.20 time: 0.333711 Aug 22 11:06:47.532938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 187/370] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 22 11:06:47 2022] POST /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:06:47.542521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:47.543138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:47.550032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:47.554958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:47.555849 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:47.556762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:47.557507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:47.558089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:47.724140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:47.734418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:47.737166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:47.738500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1aa95578-9e0e-4770-b5f4-d93569e4443f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.200184 Aug 22 11:06:47.739387 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 184/371] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:47 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:48.764553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:48.765161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:48.771772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:48.772274 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:48.772719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:48.773403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:48.773876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:48.774359 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:48.929847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:48.939380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:48.941608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:48.942971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b8b60048-bd2b-4b1c-ae69-ddcaeed7c031 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.183132 Aug 22 11:06:48.943525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 188/372] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:48 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:49.968194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:49.968783 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:49.978911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:49.979423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:49.980046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:49.980957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:49.981411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:49.982151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:50.132160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:50.140949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:50.147793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:50.147793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-adc2dc11-1b1e-4770-b486-4743de02e4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.179551 Aug 22 11:06:50.150034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 185/373] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:49 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:51.168694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:51.169288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:51.176826 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:51.177319 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:51.177769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:51.178496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:51.178964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:51.179402 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:51.335429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:51.345452 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:51.347616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:51.348839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-733f3c2c-9f0c-4dd1-99c7-d63bc2691b99 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.184223 Aug 22 11:06:51.349599 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 189/374] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:51 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:52.383010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:52.384362 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:52.391738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:52.392215 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:52.392639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:52.393341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:52.393781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:52.394317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:52.528546 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:52.539365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:52.541069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:52.542271 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7885c131-9054-49fb-9716-01a8dbaeb5f9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.173179 Aug 22 11:06:52.554291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 186/375] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:52 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:53.566778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:53.567375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:53.574170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:53.574932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:53.575583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:53.577104 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:53.578333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:53.578772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:53.748984 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:53.759016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:53.760513 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:53.761645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-218c3a47-7e01-4179-b602-2953a20594f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.199589 Aug 22 11:06:53.762251 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 190/376] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:53 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:54.786255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:54.788271 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:54.793100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:54.793601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:54.794010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:54.794773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:54.795213 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:54.795628 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:54.937745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:54.948047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:54.950199 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:54.951876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c3d68262-3a5d-45b0-8c26-2c600e31e0ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1750 microversion: 2.20 time: 0.170680 Aug 22 11:06:54.952594 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 187/377] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:54 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:55.975047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:55.975693 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:55.982549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:55.984069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:55.984069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:55.984346 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:55.984635 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:55.985089 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:56.125151 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:56.134147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:56.135907 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:56.137067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-44322738-7368-4209-993e-28558e26330c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1752 microversion: 2.20 time: 0.165985 Aug 22 11:06:56.137635 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 191/378] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:55 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:06:57.161031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:57.161641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:57.164053 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=62 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:06:57.168873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:57.169357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:57.169795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:57.170591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:57.171052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:57.171493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:57.379952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:57.394405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:57.397212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:57.409298 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-daac7ca5-1baf-4fd0-83a4-88b01512ab34 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.241666 Aug 22 11:06:57.409298 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 188/379] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:57 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:58.421184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:58.422533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:58.431681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:58.435735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:58.435735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:58.435735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:58.435735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:58.436126 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:58.698629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:58.713042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:58.714865 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:58.716260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0a38dc65-e562-4c5e-a8b4-bd745ba95a3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.298959 Aug 22 11:06:58.717165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 192/380] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:58 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:06:59.744662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:06:59.745279 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:06:59.751191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:59.751963 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:59.757313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:59.757313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:06:59.757313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:06:59.757313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:06:59.925859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:59.935132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:59.936626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:06:59.937772 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-85ca6d24-7743-4912-be02-a6adaa805ea5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.197816 Aug 22 11:06:59.938341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 189/381] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:06:59 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:00.961906 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:00.962537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:00.968956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:00.969439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:00.969870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:00.970593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:00.971039 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:00.971454 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:00.993748 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:01.153296 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:01.164265 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:01.170264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:01.170264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bbb8d6a7-4eb1-45c5-a8d3-23df55dce396 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.210125 Aug 22 11:07:01.170264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 193/382] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:00 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:02.191130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:02.191712 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:02.199484 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:02.199995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:02.208647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:02.208647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:02.208647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:02.208647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:02.370641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:02.379605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:02.381689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:02.388800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8677519f-85ad-4012-b506-35f759f6d72c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.201535 Aug 22 11:07:02.390512 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 190/383] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:02 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:03.417095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:03.417790 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:03.432596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:03.433147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:03.433576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:03.434327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:03.434774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:03.435191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:03.577200 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:03.589559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:03.591762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:03.592318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-994f0257-1257-4dba-bd37-25a722bbdecb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.179284 Aug 22 11:07:03.606342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 194/384] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:03 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:04.573478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-258117775", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "networks": [{"uuid": "b6389cfb-3b9b-462a-916a-81f9b683fb91"}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:04.617593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:04.618203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:04.627824 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:04.633844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:04.633844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:04.633844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:04.633844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:04.634410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:04.635980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] validate_networks() for [('b6389cfb-3b9b-462a-916a-81f9b683fb91', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:07:04.785181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:04.793874 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:04.796827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:04.796827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f91d8fc1-f976-4019-ba59-7482d8752312 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.183437 Aug 22 11:07:04.810254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 195/385] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:04 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:07:05.039930 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:07:05.040264 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:07:05.040739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:07:05.041143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:07:05.041592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:07:05.050627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:05.051102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:05.051526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:05.052509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:05.053327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:05.053851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:05.072554 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Getting quotas for project 2fa4a05673a14d1195ca2066b57a6cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:07:05.076697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Getting quotas for user 270a3d73e04941a4b410b3e22043db9b and project 2fa4a05673a14d1195ca2066b57a6cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:07:05.088187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:07:05.090479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:07:05.256064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7e39f46d-1017-48d7-b22c-fe1581a1251d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686486 Aug 22 11:07:05.256714 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 191/386] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:07:05.267479 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a09ac0c6-071a-4cdd-8637-71fec7d20e9d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:05.268277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a09ac0c6-071a-4cdd-8637-71fec7d20e9d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:05.322817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a09ac0c6-071a-4cdd-8637-71fec7d20e9d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:05.329997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a09ac0c6-071a-4cdd-8637-71fec7d20e9d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1218 microversion: 2.1 time: 0.066127 Aug 22 11:07:05.331531 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 196/387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:05 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:05.826578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:05.827847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:05.836754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:05.837243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:05.837678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:05.838421 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:05.838945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:05.839726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:06.008713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:06.018040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:06.019967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:06.021451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bfc5308d-80aa-4da0-95d0-50ee8edff032 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.200186 Aug 22 11:07:06.022010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 192/388] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:05 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:06.353269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-98eb48d0-00f2-4e5d-8833-91f8b6f49bf5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:06.354033 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-98eb48d0-00f2-4e5d-8833-91f8b6f49bf5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:06.409692 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98eb48d0-00f2-4e5d-8833-91f8b6f49bf5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:06.417447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-98eb48d0-00f2-4e5d-8833-91f8b6f49bf5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1218 microversion: 2.1 time: 0.069735 Aug 22 11:07:06.418004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 197/389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:06 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:07.046089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:07.047671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:07.055673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:07.059634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:07.059634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:07.059634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:07.059634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:07.060089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:07.199081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:07.208862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:07.210737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:07.212420 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7b5d6b10-4867-4260-a135-1a586cd1773e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.172011 Aug 22 11:07:07.212999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 193/390] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:07 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:07.438658 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:07.439260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:07.445662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:07.446138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:07.446633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:07.447326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:07.447774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:07.448193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:07.515075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:07.524600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f956626c-fd67-453f-9c2d-0d420d928f1d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1222 microversion: 2.1 time: 0.090032 Aug 22 11:07:07.525741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 198/391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:07 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:08.237546 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:08.238374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:08.245568 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:08.246047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:08.246860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:08.247573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:08.248040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:08.248467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:08.394719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:08.408564 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:08.410138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:08.411717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-89370fd4-23aa-4643-b44c-5c186d334bc2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.178274 Aug 22 11:07:08.428175 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 194/392] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:08 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:08.550252 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:08.550864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:08.557972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:08.558490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:08.558928 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:08.559622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:08.560075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:08.560500 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:08.638491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:08.649118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a6f83951-ac05-4634-97de-385342555052 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1222 microversion: 2.1 time: 0.102191 Aug 22 11:07:08.662857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 199/393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:08 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:09.434861 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:09.435565 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:09.441870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:09.443075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:09.443533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:09.444253 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:09.444700 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:09.445121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:09.580104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:09.589419 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:09.591090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:09.592858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dd47014c-449d-470f-9abd-c3a793839afe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.161386 Aug 22 11:07:09.593489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 195/394] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:09 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:09.678063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:09.679019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:09.685417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:09.685900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:09.686375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:09.687069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:09.687545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:09.687966 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:09.749799 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:09.758212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d87706d9-5b03-406e-a884-fa19aff37fe9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1222 microversion: 2.1 time: 0.084935 Aug 22 11:07:09.762398 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 200/395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:09 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:10.616634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:10.617172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:10.623579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:10.624108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:10.624542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:10.625228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:10.625678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:10.626099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:10.765244 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:10.774501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:10.776174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:10.777357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4f5abcc1-ab20-41d6-af3c-a31be1dc2bcf tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.165497 Aug 22 11:07:10.777956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 196/396] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:10 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:10.786918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:10.786918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:10.796402 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:10.796898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:10.797333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:10.798035 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:10.798518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:10.798943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:10.862949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:10.873195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e76da1fe-c785-49d6-8b57-395012fba767 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1270 microversion: 2.1 time: 0.097780 Aug 22 11:07:10.873706 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 201/397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:10 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:11.801866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:11.802447 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:11.816696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:11.818625 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:11.819245 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:11.820228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:11.820793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:11.821795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:11.894679 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:11.896161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:11.902904 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:11.904055 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:11.904429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:11.905167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:11.905617 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:11.906406 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:12.028425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:12.043916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:12.045851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:12.047903 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3ff014ae-48c1-4d33-8163-4d3bcdae16ab tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.250737 Aug 22 11:07:12.048657 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 197/398] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:11 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:12.094537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:12.102120 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d218d10a-435a-4dab-b343-03e48575084c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.211957 Aug 22 11:07:12.102830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 202/399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:11 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:12.746681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-151175aa-1bac-40d5-970c-60095d2bacdd req-d10b84c4-d78e-4d33-80cb-428cc4826396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56537f93-1161-4c2c-8f08-9d1e54c3d178", "tag": "25f323f3-4e21-40c9-bf02-8ab84a7f76d3"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:12.757678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-151175aa-1bac-40d5-970c-60095d2bacdd req-d10b84c4-d78e-4d33-80cb-428cc4826396 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:12.758290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-151175aa-1bac-40d5-970c-60095d2bacdd req-d10b84c4-d78e-4d33-80cb-428cc4826396 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:12.758819 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-151175aa-1bac-40d5-970c-60095d2bacdd req-d10b84c4-d78e-4d33-80cb-428cc4826396 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:12.772553 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-151175aa-1bac-40d5-970c-60095d2bacdd req-d10b84c4-d78e-4d33-80cb-428cc4826396 service nova] Creating event network-changed:25f323f3-4e21-40c9-bf02-8ab84a7f76d3 for instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 on hv-cinder-85394 Aug 22 11:07:12.776837 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-151175aa-1bac-40d5-970c-60095d2bacdd req-d10b84c4-d78e-4d33-80cb-428cc4826396 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033797 Aug 22 11:07:12.777683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 198/400] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:13.072696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:13.073302 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:13.079791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:13.080307 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:13.080850 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:13.082100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:13.082610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:13.083036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:13.125399 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:13.126709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:13.133282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:13.133949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:13.134412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:13.135533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:13.136153 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:13.136580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:13.158747 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:13.242864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:13.253220 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:13.254873 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:13.256043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6b0cf4b9-9c82-427a-862f-28f188529a6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.188263 Aug 22 11:07:13.256600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 203/401] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:13 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:13.372326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:13.381542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8988bb2f-cff4-4d0a-a3c5-fca5b6a3a4c5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.261305 Aug 22 11:07:13.382714 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 199/402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:13 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:14.279233 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:14.279948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:14.286955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:14.287370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:14.287804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:14.288565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:14.289006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:14.289557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:14.402116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:14.402817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:14.409059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:14.410970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:14.410970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:14.410970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:14.411480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:14.411849 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:14.425682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:14.437492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:14.437492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:14.439117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-27186a64-1474-4f5d-a3be-afe2b17034d7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.163754 Aug 22 11:07:14.450251 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 204/403] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:14 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:14.555460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:14.563758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c9bf486f-f1ff-4b7b-903c-dcc0db852225 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.165437 Aug 22 11:07:14.564543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 200/404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:14 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:15.464474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:15.465085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:15.471615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:15.472105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:15.472543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:15.473276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:15.473727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:15.474172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:15.586739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:15.587347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:15.589161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:15.589852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=6 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:15.595065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:15.595547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:15.595981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:15.596675 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:15.597126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:15.597542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:15.642062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:15.655580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:15.657188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:15.661435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-defc36f1-7792-4cf8-9f07-abb682e408ea tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.198104 Aug 22 11:07:15.661435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 205/405] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:15 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:15.738194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:15.745823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d28da230-6a3a-4385-9c35-4e23c07b9bca tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.163573 Aug 22 11:07:15.746436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 201/406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:15 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:16.683063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:16.683677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:16.685510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:16.690955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:16.691445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:16.693198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:16.693921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:16.694413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:16.694842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:16.767936 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:16.768869 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:16.776929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:16.777625 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:16.778478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:16.779246 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:16.779935 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:16.780588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:16.848471 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:16.864115 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:16.866760 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:16.868625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-39b9df3f-3f60-4a93-929a-866a17c05fa8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.189439 Aug 22 11:07:16.870533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 206/407] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:16 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:16.988736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:16.997129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a15500f0-64a7-49c6-b5d9-7d566aea76f5 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.233637 Aug 22 11:07:16.997829 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 202/408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:16 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:17.893009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:17.894167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:17.901303 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=43 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:17.902972 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:17.903455 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:17.903880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:17.904734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:17.905456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:17.911659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:18.025194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:18.027018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:18.034857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:18.036439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:18.037054 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:18.037954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:18.038625 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:18.039239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:18.157434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:18.176315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:18.180166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:18.183580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dfa4ad55-c211-4f11-9c7f-b1f8b497576c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.292505 Aug 22 11:07:18.184161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 207/409] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:17 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:18.403501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:18.412773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7aed7093-5146-4fdc-a006-b49516fceec9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.396552 Aug 22 11:07:18.426188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 203/410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:18 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:19.209273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:19.210580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:19.217463 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:19.222077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:19.222077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:19.222077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:19.222077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:19.222411 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:19.392393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:19.402768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:19.406718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:19.406718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c192bfce-56f7-4506-b4fe-af471d70252f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.201523 Aug 22 11:07:19.418526 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 208/411] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:19 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:19.433114 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:19.435567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:19.440092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:19.440567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:19.440999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:19.441953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:19.442430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:19.442848 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:19.658943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:19.667659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ad650532-88f2-4f37-be75-9b5ce7586442 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.238283 Aug 22 11:07:19.668708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 204/412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:19 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:19.986388 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-33bde53e-2d0a-42b4-8780-96f102e83433 req-fa7e1954-8c01-49ea-91cf-e1c882d1cc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "name": "network-vif-plugged", "status": "completed", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:19.997575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-33bde53e-2d0a-42b4-8780-96f102e83433 req-fa7e1954-8c01-49ea-91cf-e1c882d1cc24 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:19.998573 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-33bde53e-2d0a-42b4-8780-96f102e83433 req-fa7e1954-8c01-49ea-91cf-e1c882d1cc24 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:19.999012 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-33bde53e-2d0a-42b4-8780-96f102e83433 req-fa7e1954-8c01-49ea-91cf-e1c882d1cc24 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:20.011543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-33bde53e-2d0a-42b4-8780-96f102e83433 req-fa7e1954-8c01-49ea-91cf-e1c882d1cc24 service nova] Creating event network-vif-plugged:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:07:20.020772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-33bde53e-2d0a-42b4-8780-96f102e83433 req-fa7e1954-8c01-49ea-91cf-e1c882d1cc24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035111 Aug 22 11:07:20.020772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 209/413] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:20.429456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:20.429984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:20.436678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:20.437256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:20.437588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:20.438418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:20.438871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:20.439286 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:20.617901 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:20.626753 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:20.628400 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:20.630329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cb84d591-a8ff-4351-9d75-01e390666fee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.205459 Aug 22 11:07:20.636378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 205/414] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:20 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:20.694175 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:20.696899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:20.717251 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:20.718564 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:20.719501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:20.721628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:20.725554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:20.725554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:20.974677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:20.987746 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e5ba2584-6d29-45c9-aecc-970301f96d04 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.298145 Aug 22 11:07:20.996323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 210/415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:20 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:21.653000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:21.654183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:21.662589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:21.663082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:21.663520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:21.664220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:21.664794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:21.665223 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:22.013796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:22.014962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:22.022496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:22.023011 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:22.023696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:22.024470 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:22.025498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:22.026945 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:22.052988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:22.063288 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:22.065051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:22.067156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bfc05baf-5103-4da8-9818-df1406f4df3b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.417267 Aug 22 11:07:22.068860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 206/416] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:21 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:22.132572 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-831ecc71-8e2a-4d26-b8cd-6a222c6ad2e9 req-6b717fb1-ede5-405c-a96d-0d045ff58040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56537f93-1161-4c2c-8f08-9d1e54c3d178", "name": "network-vif-plugged", "status": "completed", "tag": "25f323f3-4e21-40c9-bf02-8ab84a7f76d3"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:22.142567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-831ecc71-8e2a-4d26-b8cd-6a222c6ad2e9 req-6b717fb1-ede5-405c-a96d-0d045ff58040 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:22.143050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-831ecc71-8e2a-4d26-b8cd-6a222c6ad2e9 req-6b717fb1-ede5-405c-a96d-0d045ff58040 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:22.143482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-831ecc71-8e2a-4d26-b8cd-6a222c6ad2e9 req-6b717fb1-ede5-405c-a96d-0d045ff58040 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:22.162780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-831ecc71-8e2a-4d26-b8cd-6a222c6ad2e9 req-6b717fb1-ede5-405c-a96d-0d045ff58040 service nova] Creating event network-vif-plugged:25f323f3-4e21-40c9-bf02-8ab84a7f76d3 for instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 on hv-cinder-85394 Aug 22 11:07:22.168488 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-831ecc71-8e2a-4d26-b8cd-6a222c6ad2e9 req-6b717fb1-ede5-405c-a96d-0d045ff58040 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040368 Aug 22 11:07:22.169707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 207/417] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:22.240165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:22.248769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d44aee5f-1459-47aa-b52e-8bf66a56023b tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.239007 Aug 22 11:07:22.253165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 211/418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:22 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:23.092000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:23.092967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:23.100372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:23.101315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:23.102005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:23.103076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:23.104228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:23.104731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:23.254160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:23.264184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:23.265691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:23.266991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1046a957-56fc-483b-bc6e-568de9f99a1f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.180489 Aug 22 11:07:23.267986 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 208/419] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:23 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:23.289138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:23.289756 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:23.296482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:23.296962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:23.298166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:23.298899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:23.299539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:23.299953 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:23.539915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:23.542155 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:23.549635 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ee6047dd-a5b9-4415-8128-fc83828a2a6a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1318 microversion: 2.1 time: 0.269195 Aug 22 11:07:23.550557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 212/420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:23 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:24.296077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:24.297787 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:24.311082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:24.312333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:24.315085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:24.317399 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:24.319770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:24.320685 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:24.574864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:24.575714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:24.583240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:24.583821 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:24.584540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:24.585338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:24.586010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:24.586783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:24.627076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:24.653782 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:24.659258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:24.660807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7fc12574-887b-41f6-b02a-cc4f9112c3e0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1808 microversion: 2.20 time: 0.369376 Aug 22 11:07:24.661376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 209/421] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:24 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1808 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:24.773817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:24.782857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df75128f-3e34-466c-8bd9-20fffe61782d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1506 microversion: 2.1 time: 0.214796 Aug 22 11:07:24.784322 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 213/422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:24 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:25.689690 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:25.691235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:25.702062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:25.704077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:25.705778 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:25.707826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:25.711013 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:25.711452 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:25.911959 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:25.921394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:25.922941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:25.924128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-058f848d-3568-43d4-8832-1532d7a949bc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1795 microversion: 2.20 time: 0.238969 Aug 22 11:07:25.924684 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 210/423] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:07:25 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1795 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:07:28.209207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:28.210594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:28.218892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.230956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.230956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.232411 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.233175 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.233839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.287104 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0dfa0ee4-2054-4070-91ce-8f867197c735 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/ips" status: 200 len: 150 microversion: 2.1 time: 0.082555 Aug 22 11:07:28.288119 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 214/424] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:07:28 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:28.300792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a405d4d4-da1e-4067-b3d6-b8436edbd17c"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:28.304071 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:28.318388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:28.320260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.320970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.321567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.324435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.335094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.335094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.470173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Invalid volume: volume a405d4d4-da1e-4067-b3d6-b8436edbd17c is already attached to instances: 5ff96ff0-c3fa-48a3-8483-065985f353b2 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: POST /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/os-volume_attachments HTTP/1.1 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 74 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:07:28.472915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {"volumeAttachment": {"volumeId": "a405d4d4-da1e-4067-b3d6-b8436edbd17c"}} Aug 22 11:07:28.474321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Invalid volume: volume a405d4d4-da1e-4067-b3d6-b8436edbd17c is already attached to instances: 5ff96ff0-c3fa-48a3-8483-065985f353b2 Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'server_id': '56b9e6d6-e6f5-46d0-8304-e309558d2819', 'body': {'volumeAttachment': {'volumeId': 'a405d4d4-da1e-4067-b3d6-b8436edbd17c'}}} Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a405d4d4-da1e-4067-b3d6-b8436edbd17c is already attached to instances: 5ff96ff0-c3fa-48a3-8483-065985f353b2 Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:07:28.475046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a405d4d4-da1e-4067-b3d6-b8436edbd17c is already attached to instances: 5ff96ff0-c3fa-48a3-8483-065985f353b2 Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:28.476198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:07:28.477464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:07:28.477464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:07:28.477464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:07:28.477464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a405d4d4-da1e-4067-b3d6-b8436edbd17c is already attached to instances: 5ff96ff0-c3fa-48a3-8483-065985f353b2 Aug 22 11:07:28.477464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:07:28.479366 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 400 to user: Invalid volume: volume a405d4d4-da1e-4067-b3d6-b8436edbd17c is already attached to instances: 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:07:28.481869 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-aae5d6ae-8f53-4765-a22d-0676e46f0a36 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.186984 Aug 22 11:07:28.486197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 211/425] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:07:28 2022] POST /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819/os-volume_attachments => generated 174 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:07:28.493093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:28.493845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:28.500727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.501212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.501642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.502438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.502889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.504339 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.533876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:07:28.780255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d06de300-2cd9-4e0d-9328-1f974df3a8fc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 204 len: 0 microversion: 2.1 time: 0.292150 Aug 22 11:07:28.780888 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 215/426] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:07:28 2022] DELETE /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:07:28.792858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:28.793731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:28.800578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.801233 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.803517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.803517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:28.803517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:28.803517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:28.990907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:29.001860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-622901b9-2889-49ad-afdb-0ca1eb6131a8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1682 microversion: 2.1 time: 0.211750 Aug 22 11:07:29.002843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 212/427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:28 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:30.024551 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:30.025324 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:30.039939 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:30.040430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:30.041077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:30.042386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:30.043469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:30.044404 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:30.266535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:30.276088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-237198d2-8c9a-47b9-9483-e8b1c64cf1fd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1682 microversion: 2.1 time: 0.256393 Aug 22 11:07:30.293091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 216/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:30 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:31.305511 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:31.306939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:31.323130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:31.323971 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:31.325629 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:31.326865 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:31.327514 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:31.328127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:31.568142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:31.577524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-11974ae2-6dcd-445f-a214-4756e8e93345 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1682 microversion: 2.1 time: 0.277637 Aug 22 11:07:31.602792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 213/429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:31 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:31.905266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96914217-f278-4af0-9508-265b621791f4"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:31.908039 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:31.928815 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:31.929450 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:31.929990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:31.931363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:31.931925 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:31.932448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:32.444385 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-b1a0d6bb-eff8-4914-bee0-869d9f6f1a74 req-e165d45f-b9cd-4b55-9455-c067298f9b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b9e6d6-e6f5-46d0-8304-e309558d2819", "name": "network-vif-deleted", "tag": "46c50266-ff83-4fdd-99f6-28c11d2f2a91"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:32.474481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b1a0d6bb-eff8-4914-bee0-869d9f6f1a74 req-e165d45f-b9cd-4b55-9455-c067298f9b5b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:32.476051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b1a0d6bb-eff8-4914-bee0-869d9f6f1a74 req-e165d45f-b9cd-4b55-9455-c067298f9b5b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:32.476948 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b1a0d6bb-eff8-4914-bee0-869d9f6f1a74 req-e165d45f-b9cd-4b55-9455-c067298f9b5b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:32.496168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-b1a0d6bb-eff8-4914-bee0-869d9f6f1a74 req-e165d45f-b9cd-4b55-9455-c067298f9b5b service nova] Creating event network-vif-deleted:46c50266-ff83-4fdd-99f6-28c11d2f2a91 for instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 on hv-cinder-85394 Aug 22 11:07:32.501461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-b1a0d6bb-eff8-4914-bee0-869d9f6f1a74 req-e165d45f-b9cd-4b55-9455-c067298f9b5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066962 Aug 22 11:07:32.507311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 214/430] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:07:32.618627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:32.619620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:32.648906 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:32.649402 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:32.649843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:32.652584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:32.653077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:32.654141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:32.795998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:32.806283 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6e1bf20f-2748-4642-be04-ad87c98dc182 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1327 microversion: 2.1 time: 0.207483 Aug 22 11:07:32.807696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 215/431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:32 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1327 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:33.118858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8ba7778d-5142-408e-9841-8e59ec5931ff tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.217308 Aug 22 11:07:33.146967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 217/432] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:07:31 2022] POST /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 194 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:33.838621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:33.898932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:33.898932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:33.898932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:33.898932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:33.900497 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:33.900497 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:33.900497 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:33.987876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:33.987876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:33.987876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:33.987876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 56b9e6d6-e6f5-46d0-8304-e309558d2819 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:34.001618 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:34.014116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-52bb4b60-18ff-43b0-a6c1-48d5c8c8d972 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 200 len: 1332 microversion: 2.1 time: 0.185494 Aug 22 11:07:34.026255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 216/433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:33 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 1332 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:35.039277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:35.040641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:35.063152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:35.066111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:35.066806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:35.070975 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:35.075420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:35.076093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:35.116455 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 HTTP/1.1 Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:07:35.120556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:07:35.121902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '56b9e6d6-e6f5-46d0-8304-e309558d2819'} Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:07:35.122690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:07:35.123880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:35.126886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:07:35.128696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-755c3ff8-611b-42ec-841f-31e753fea19d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 404 len: 111 microversion: 2.1 time: 0.095003 Aug 22 11:07:35.129482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 218/434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:35 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:07:35.138075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-85a60054-347d-401d-901b-8ddfd053e57f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '.version_select at 0x7f3b4c818040>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:35.256214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-85a60054-347d-401d-901b-8ddfd053e57f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137023031" status: 202 len: 0 microversion: 2.1 time: 0.122040 Aug 22 11:07:35.256853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 217/435] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 22 11:07:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137023031 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:07:36.498446 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:36.498978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:36.512960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:36.514098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:36.514098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:36.515086 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:36.515934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:36.516473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:36.672030 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'services' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:37.179592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-39ba4fe3-de58-4010-b005-0a182ef19926 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments/a405d4d4-da1e-4067-b3d6-b8436edbd17c" status: 202 len: 0 microversion: 2.1 time: 0.688188 Aug 22 11:07:37.181544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 219/436] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:07:36 2022] DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments/a405d4d4-da1e-4067-b3d6-b8436edbd17c => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:07:37.193182 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:37.196827 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:37.205741 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:37.206541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:37.207344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:37.208425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:37.208882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:37.209304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:37.212257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:37.243514 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-836ec140-430e-47e6-919b-fd10ab8983b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058413 Aug 22 11:07:37.244277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 218/437] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:07:37 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:38.257288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:38.259839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:38.267181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:38.267690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:38.268711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:38.269570 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:38.270016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:38.270893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:38.308262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9fc534c2-89c2-4cac-b6e4-fa33fd80a66a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055956 Aug 22 11:07:38.309168 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 220/438] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:07:38 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:39.324057 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:39.326166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:39.336225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:39.336718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:39.337147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:39.337879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:39.338387 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:39.339140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:39.379956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6f043fad-4eaf-4c5d-bead-97457606b51a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060378 Aug 22 11:07:39.381214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 219/439] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:07:39 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:40.392319 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:40.395389 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:40.401823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:40.402471 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:40.403145 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:40.404003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:40.404494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:40.404919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:40.438685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9194f974-c0c0-454c-a9b5-a4602b8cd7f8 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050170 Aug 22 11:07:40.439997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 221/440] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:07:40 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:41.148610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dc02bdc5-8439-4df5-9397-e36a0cc56c65 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Action: 'create', calling method: .version_select at 0x7f3b4c86f280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1153806202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA5+ZeS6x0Xg7X9GWaJXAEY1k6pQVLyuG7wsZvetyN04iZH7UUvFTzddIyejqXjNOrRxrRdQDABOky6EX+roi9jmxIQxSbop8u3hiS5ZbJD5FYBrD1+5nHwkcS6MJ0Zvg=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:41.166832 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-dc02bdc5-8439-4df5-9397-e36a0cc56c65 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Getting quotas for project 0533d69c876f4cbdbf6b7138abf37893. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:07:41.170549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-dc02bdc5-8439-4df5-9397-e36a0cc56c65 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Getting quotas for user 93ec72fc30ea45d5952bf9f29311e4ac and project 0533d69c876f4cbdbf6b7138abf37893. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:07:41.259678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dc02bdc5-8439-4df5-9397-e36a0cc56c65 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.115568 Aug 22 11:07:41.260279 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 220/441] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:07:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:07:41.309581 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-604689565", "imageRef": "1873f595-550a-4b0d-a833-5c308d4ccc6a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1153806202", "networks": [{"uuid": "6eaf59c2-9e9f-4657-b7d4-2f3aeb60689e"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:41.360668 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] validate_networks() for [('6eaf59c2-9e9f-4657-b7d4-2f3aeb60689e', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:07:41.452167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:41.454374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:41.462001 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:41.462683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:41.463122 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:41.463814 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:41.464265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:41.464691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:41.494745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4347c2c4-d1b7-4019-b0da-29d88ad0bd19 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046416 Aug 22 11:07:41.500378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 221/442] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:07:41 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:41.754285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:07:41.754948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:07:41.755424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:07:41.755831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:07:41.756240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:07:41.765342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:41.765820 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:41.766270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:41.766990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:41.767435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:41.767926 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:41.786135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Getting quotas for project 0533d69c876f4cbdbf6b7138abf37893. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:07:41.790169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Getting quotas for user 93ec72fc30ea45d5952bf9f29311e4ac and project 0533d69c876f4cbdbf6b7138abf37893. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:07:41.801974 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:07:41.803980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1873f595-550a-4b0d-a833-5c308d4ccc6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:07:41.896856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8da62b73-03e8-43db-98aa-5c8715c64072 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591051 Aug 22 11:07:41.898299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 222/443] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:07:41.909098 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-06c209ed-02a1-49f6-99d2-0880eee2be3d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:41.909716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-06c209ed-02a1-49f6-99d2-0880eee2be3d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:41.940806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:41.943065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:41.949856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:41.955864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:41.955864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:41.955864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:41.955864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:41.956203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:41.975917 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lazy-loading 'flavor' on Instance uuid 790ba6d2-ada3-468b-bb51-1fca7bc7c349 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:41.990335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-06c209ed-02a1-49f6-99d2-0880eee2be3d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:41.999597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-06c209ed-02a1-49f6-99d2-0880eee2be3d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1258 microversion: 2.1 time: 0.094962 Aug 22 11:07:42.001595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 222/444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:41 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1258 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:42.275457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e140c6f8-45c0-43fb-ba26-7b00caf3a2d0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/action" status: 200 len: 32 microversion: 2.1 time: 0.338477 Aug 22 11:07:42.276074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 223/445] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:07:41 2022] POST /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 11:07:42.285807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:42.286646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:42.293749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.294369 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.294802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.295499 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.296077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.296427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.480600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:42.489093 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ea7efd87-da3a-454f-8f45-eace896c1f2c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.207261 Aug 22 11:07:42.489670 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 223/446] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:42 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:42.510188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:42.513803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:42.526038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.526667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.527116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.527817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.528263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.528679 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.561717 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2465a14b-2bd2-40fa-8351-dbd541fd013e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057280 Aug 22 11:07:42.562358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 224/447] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:07:42 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 11:07:42.631881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:42.632379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:42.638387 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.638865 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.639299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.640031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.640518 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.640932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.666294 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:07:42.895964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4842e3ac-147d-45da-bb7b-0d1715674509", "device": "/dev/sdb"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:42.898803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:42.904666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.905154 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.905588 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.906299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.906754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.907169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.925038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:42.945311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-89519dcb-8cad-4bb2-aff8-7719c84de0c1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 204 len: 0 microversion: 2.1 time: 0.317317 Aug 22 11:07:42.947058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 224/448] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:07:42 2022] DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:07:42.955771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:42.956723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:42.963924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.964724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.965075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:42.965941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:42.966521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:42.966975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:43.109260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:43.117705 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8d806053-7645-4f9e-b2d8-5a6ab7d04b4a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1682 microversion: 2.1 time: 0.166592 Aug 22 11:07:43.118208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 225/449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:42 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:43.122609 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:43.123209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:43.128878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:43.129351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:43.131767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:43.131767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:43.131767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:43.131767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:43.191046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:43.198528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b85b350a-b3a6-46b6-9f45-15d7d6a83751 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1262 microversion: 2.1 time: 0.079345 Aug 22 11:07:43.199099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 226/450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:43 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:43.524507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:43.525146 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:43.531537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:43.532020 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:43.532447 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:43.533147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:43.533604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:43.534022 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:43.662802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:43.670981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6e1377fa-d2f6-4743-b598-cc6ec0f342e6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.150260 Aug 22 11:07:43.671546 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 227/451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:43 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:44.139165 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:44.139716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:44.145751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:44.146244 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:44.146682 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:44.147358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:44.147803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:44.148219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:44.278388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:44.286098 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-899a4af9-51d2-4c0b-b4cc-90ec180c55d4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1682 microversion: 2.1 time: 0.150854 Aug 22 11:07:44.286858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 228/452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:44 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:44.291206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:44.292064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:44.298311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:44.298796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:44.299321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:44.300981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:44.301457 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:44.301878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:44.370559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:44.378923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1dd2bf6d-5df1-4a3b-a7b4-02db49fe6fe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1262 microversion: 2.1 time: 0.090489 Aug 22 11:07:44.379492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 229/453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:44 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:44.694966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:44.697029 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:44.707455 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:44.711389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:44.711389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:44.711389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:44.711389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:44.711814 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:44.945887 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:44.954379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-96bd7b36-d5d0-4100-89ae-a752e3572b10 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.265332 Aug 22 11:07:44.955077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 230/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:44 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:45.028789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-088fb579-4655-479d-830a-c4c594faaf75 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "POST /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.136586 Aug 22 11:07:45.029568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 225/455] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:07:42 2022] POST /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178/os-volume_attachments => generated 194 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:07:45.307838 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:45.308510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:45.314581 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.315060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.316027 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:45.316812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.317275 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.317696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:45.401201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:45.401947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:45.410674 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.410960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:45.412154 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.412687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:45.413583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.414165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.415061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:45.421104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7f8d8fe0-e242-480e-8e42-d9a60ebb0332 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1614 microversion: 2.1 time: 0.117014 Aug 22 11:07:45.434461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 231/456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:45 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1614 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:45.526205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:45.542100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6a4edbd6-4cca-45df-848c-308676f95dd6 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1318 microversion: 2.1 time: 0.145207 Aug 22 11:07:45.554461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 226/457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:45 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:45.735521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-2ab3178b-a1bf-4280-9d2c-7a9ca1aa8a02 req-902b5831-9a16-41bf-8230-7d3fd3643379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff96ff0-c3fa-48a3-8483-065985f353b2", "name": "network-vif-deleted", "tag": "de7412eb-f311-4316-8363-cb7f23a43ba7"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:45.746558 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-2ab3178b-a1bf-4280-9d2c-7a9ca1aa8a02 req-902b5831-9a16-41bf-8230-7d3fd3643379 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.747836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-2ab3178b-a1bf-4280-9d2c-7a9ca1aa8a02 req-902b5831-9a16-41bf-8230-7d3fd3643379 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.749022 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-2ab3178b-a1bf-4280-9d2c-7a9ca1aa8a02 req-902b5831-9a16-41bf-8230-7d3fd3643379 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:45.767802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-2ab3178b-a1bf-4280-9d2c-7a9ca1aa8a02 req-902b5831-9a16-41bf-8230-7d3fd3643379 service nova] Creating event network-vif-deleted:de7412eb-f311-4316-8363-cb7f23a43ba7 for instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 on hv-cinder-85394 Aug 22 11:07:45.778119 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-2ab3178b-a1bf-4280-9d2c-7a9ca1aa8a02 req-902b5831-9a16-41bf-8230-7d3fd3643379 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046124 Aug 22 11:07:45.779330 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 232/458] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:45.978492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:45.979138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:45.990393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.991417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.994487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:45.999051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:45.999051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:45.999051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:46.236400 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:46.247890 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1f303021-2848-47ef-a972-c2be841edf92 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.275925 Aug 22 11:07:46.253438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 227/459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:45 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:46.447720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:46.448429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:46.465609 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:46.466439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:46.467083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:46.468035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:46.471903 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:46.472733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:46.515721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:46.516586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:46.517230 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:46.517890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:46.567784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:46.568680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:46.586949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:46.596920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:46.596920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:46.596920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:46.596920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:46.597977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:46.598082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:46.608313 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e708dfe3-3893-4074-834e-0db34691a4c6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.165109 Aug 22 11:07:46.609018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 233/460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:46 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:46.886950 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:46.903217 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0b89164e-8113-49da-8f80-c9cd5956fef8 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.339522 Aug 22 11:07:46.904818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 228/461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:46 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:47.271766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:47.272381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:47.279318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.279952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.280994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.281754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.282411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.282845 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.441272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:47.449617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-41df953a-c78f-4ba4-9079-f88f526fb768 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.182642 Aug 22 11:07:47.450178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 234/462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:47 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:47.633064 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:47.634873 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:47.642745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.643603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.644699 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.645772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.646519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.647282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.681662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.682142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.682610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.683065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:47.738911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:47.748640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d3067f3f-6f34-42fb-b902-135b1f1744c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.120171 Aug 22 11:07:47.749398 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 229/463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:47 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:47.926988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:47.926988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:47.932463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.932957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.933396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.934102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:47.934582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:47.935009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:47.954703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:48.102333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:48.110641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c739b9ee-16f6-445e-80d5-ccedfc2e391f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.189558 Aug 22 11:07:48.111432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 235/464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:47 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:48.471484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:48.471484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:48.473739 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:48.478768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:48.479249 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:48.479677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:48.480638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:48.481141 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:48.481555 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:48.622109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:48.630993 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d42ce119-7218-4be8-8f6e-78f2161b90f6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.163754 Aug 22 11:07:48.631795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 230/465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:48 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:48.768965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:48.769635 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:48.776223 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:48.776698 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:48.777126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:48.777801 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:48.778256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:48.778681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:48.824748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:48.825410 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:48.825931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:48.826555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:48.882171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:48.890577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a56402b5-418b-4d98-b998-9cb348999a60 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.125422 Aug 22 11:07:48.891149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 236/466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:48 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:49.132263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:49.132788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:49.139043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.139513 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.139939 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.140651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.141096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.141512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.282864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:49.291717 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff3ce8ab-c784-42b1-b24f-b1ee5b6c23d4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.163080 Aug 22 11:07:49.292638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 231/467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:49 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:49.652399 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:49.652905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:49.659135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.659622 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.660114 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.660804 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.661254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.661779 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.789936 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:49.798288 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-972705b5-de26-4e15-b135-2e5b0776dcc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.149845 Aug 22 11:07:49.798924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 237/468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:49 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:49.912166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:49.912702 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:49.918692 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.919181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.919619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.920950 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.921420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.921851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.954830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:49.955293 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:49.955726 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:49.956204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:50.001676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:50.009814 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e97eac2e-9a21-4a08-9b5b-7aa4b6f05467 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.102096 Aug 22 11:07:50.010436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 232/469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:49 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:50.314249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:50.314856 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:50.320789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:50.321268 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:50.321697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:50.322408 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:50.322855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:50.323272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:50.486188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:50.495709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7c5edc3f-0c04-4248-b7a8-5dc28af7aefb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.185229 Aug 22 11:07:50.496417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 238/470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:50 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:50.825027 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:50.825659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:50.832569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:50.833042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:50.833476 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:50.834160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:50.834633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:50.835055 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:50.978298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:50.986853 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-33d5f683-9456-4c3b-b960-4ce936506d35 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.165760 Aug 22 11:07:50.987508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 233/471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:50 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:51.033533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:51.035260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:51.041910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:51.042602 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:51.043097 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:51.043915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:51.044365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:51.045065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:51.078798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:51.079201 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:51.079660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:51.080086 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:51.126989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:51.136282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-926bba11-12ec-431f-abdc-3743e0b3f655 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.109249 Aug 22 11:07:51.136860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 239/472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:51 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:51.521495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:51.537784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:51.537784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:51.537784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:51.537784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:51.538403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:51.538403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:51.538403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:51.676983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:51.685714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eaf4ed03-b5be-49d0-b5f5-25f1802afcbd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.171489 Aug 22 11:07:51.686492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 234/473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:51 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:52.010356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:52.011122 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:52.013826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=6 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:52.021612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.022618 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.023435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.024570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.025243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.025789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.164438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:52.165200 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:52.167064 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:52.167728 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:52.172880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.173013 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:52.173440 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.173778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.174497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.175686 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.176531 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.184486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-54b16392-0f32-4d7a-8786-fae85c8df200 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.178915 Aug 22 11:07:52.185357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 240/474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:52 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:52.215361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.215845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.216284 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.216790 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:52.267456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:52.276085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0ea996df-cf03-4548-8bfd-d332bfd49a6a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.115700 Aug 22 11:07:52.276599 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 235/475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:52 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:52.710090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:52.711037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:52.718368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.718887 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.719710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.720446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:52.720900 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:52.722055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:52.895349 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:52.904498 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-aa918b36-e0e2-41f7-827b-141d688cb000 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.201013 Aug 22 11:07:52.918697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 241/476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:52 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:53.208937 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:53.209545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:53.218122 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.218671 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.219102 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:53.219924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.220420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.220846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:53.297115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:53.297820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:53.305719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.306448 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.307038 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:53.307866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.308392 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.309149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:53.363905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.364398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.364874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:53.365303 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:53.387729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:53.397263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-369851f9-f35d-4cec-9354-18c0240f0c01 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.194450 Aug 22 11:07:53.398161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 236/477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:53 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:53.414467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:53.422731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5d37c1b4-ebdc-438e-bea9-59afbb09e569 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.129514 Aug 22 11:07:53.423481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 242/478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:53 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:53.926543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:53.927068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:53.933158 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.933643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.934176 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:53.934802 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:53.935255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:53.935677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:54.070802 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:54.079145 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43e44439-49b3-47c4-86ec-956a89c01f21 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.156817 Aug 22 11:07:54.079749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 237/479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:53 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:54.418617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:54.419394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:54.425913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:54.426450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:54.426884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:54.427567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:54.428018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:54.428438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:54.444774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:54.445376 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:54.451582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:54.452062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:54.452496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:54.453186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:54.453639 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:54.454060 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:54.486991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:54.487562 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:54.488031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:54.488485 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:54.545804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:54.554713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c59aca0d-ee1a-47fc-938a-8061eb554aed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.114076 Aug 22 11:07:54.555361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 238/480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:54 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:54.568500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:54.574538 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-495f1bf0-715d-4b55-a264-a0b2fcd5b094 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.159820 Aug 22 11:07:54.575118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 243/481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:54 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:55.100238 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:55.100900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:55.107633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.108113 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.108554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.109253 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.109704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.110127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.125363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:55.250549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:55.258980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f7a5357a-edda-4bea-85f3-c83456967011 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.163046 Aug 22 11:07:55.259537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:55 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:55.576438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:55.577045 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:55.583835 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.584322 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.584785 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.585476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.585929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.586378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.595967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:55.596597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:55.603008 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.603506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.603942 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.604624 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.605070 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.605749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.618463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:55.618947 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:55.619382 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:55.619831 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 5ff96ff0-c3fa-48a3-8483-065985f353b2 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:07:55.660479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:55.668135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fddcec1e-8b3c-4a93-aca2-d3adaf56b5c2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 200 len: 1332 microversion: 2.1 time: 0.095759 Aug 22 11:07:55.668710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 244/483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:55 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:55.735245 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:55.743386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b5e98237-51cf-4a3f-95e6-9f86c79320e7 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.151272 Aug 22 11:07:55.743943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 240/484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:55 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:56.279927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:56.280585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:56.285329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:07:56.288693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.289172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.289601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.290321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.290810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.291245 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.434558 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:56.442790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-22544078-4125-4681-baf5-6e773e658622 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.166793 Aug 22 11:07:56.443357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 245/485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:56 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:56.689494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:56.690050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:56.698048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.698742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.699174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.699865 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.700315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.700732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.715948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 HTTP/1.1 Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:07:56.717549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:07:56.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '5ff96ff0-c3fa-48a3-8483-065985f353b2'} Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:07:56.720037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:07:56.721436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:07:56.722715 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:07:56.722715 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-48c264f7-3977-4072-9137-db576ff8941d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 404 len: 111 microversion: 2.1 time: 0.033432 Aug 22 11:07:56.722715 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 241/486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:56 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:07:56.728137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b458e6c6-da5b-4343-b4e8-d7356c0dd803 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '.version_select at 0x7f3b4c875dc0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:56.766338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:56.766944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:56.774293 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.774791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.775236 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.775942 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.776469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.776890 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.815017 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b458e6c6-da5b-4343-b4e8-d7356c0dd803 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280105896" status: 202 len: 0 microversion: 2.1 time: 0.090753 Aug 22 11:07:56.816192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 246/487] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 22 11:07:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280105896 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:07:56.824996 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-133d1a5c-26b1-438f-b85b-ba53072040e3 req-5efab350-b21d-4167-894e-11d79bf12ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:56.832546 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-133d1a5c-26b1-438f-b85b-ba53072040e3 req-5efab350-b21d-4167-894e-11d79bf12ce8 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:56.833028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-133d1a5c-26b1-438f-b85b-ba53072040e3 req-5efab350-b21d-4167-894e-11d79bf12ce8 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:56.833556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-133d1a5c-26b1-438f-b85b-ba53072040e3 req-5efab350-b21d-4167-894e-11d79bf12ce8 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:56.845165 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-133d1a5c-26b1-438f-b85b-ba53072040e3 req-5efab350-b21d-4167-894e-11d79bf12ce8 service nova] Creating event network-changed:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:07:56.850668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-133d1a5c-26b1-438f-b85b-ba53072040e3 req-5efab350-b21d-4167-894e-11d79bf12ce8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032957 Aug 22 11:07:56.851271 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 247/488] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:07:57.156340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:57.164943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-22d0cb5f-d8b8-41ae-af2a-12a488e80ae6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.403888 Aug 22 11:07:57.165860 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 242/489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:56 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:07:57.463925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:57.464607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:57.470665 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:57.471144 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:57.471573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:57.472750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:57.473196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:57.473672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:57.657136 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-938f11d8-0ae4-4ef3-ad5b-4ccc9fdd3b24 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: .version_select at 0x7f3b4c6e88b0>, body: {"keypair": {"name": "tempest-keypair-301855822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSLD1Zn9vfYl3AS9ieDgdFXMdW26vAXwOpJIROJCj1pKU0W9u6TJfVVluxbj8lolo5qXqqwNAxus2GLVbcNMg5wBVFUxbBNplwIde/0gGOj7FmgSE1aLbBes1m13wQfuA=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:07:57.657936 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:57.666352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7f9bb8e8-ccf0-4755-b967-9bf20e7142ea tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.206764 Aug 22 11:07:57.666925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 248/490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:57 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:57.675979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-938f11d8-0ae4-4ef3-ad5b-4ccc9fdd3b24 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:07:57.679824 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-938f11d8-0ae4-4ef3-ad5b-4ccc9fdd3b24 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:07:57.763281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-938f11d8-0ae4-4ef3-ad5b-4ccc9fdd3b24 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110219 Aug 22 11:07:57.763883 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 243/491] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:07:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:07:58.185915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:58.187519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:58.193515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:58.194073 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:58.196769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:58.196769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:58.196769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:58.196769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:58.332315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:58.341709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f70a80c9-8423-4a4f-a5ed-32f221057a52 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.159417 Aug 22 11:07:58.342317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 249/492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:58 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:58.687478 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:58.688102 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:58.694589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:58.695067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:58.695492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:58.696186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:58.696629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:58.697047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:58.873179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:58.881461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9560fb5c-4763-4853-b001-3b84aa6260b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.197986 Aug 22 11:07:58.884396 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 244/493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:58 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:59.362797 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:59.364190 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:59.372260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:59.372742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:59.373368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:59.374874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:59.375324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:59.375928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:59.561755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:07:59.571454 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-df68288e-51d6-4630-8210-16bf9a730571 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1736 microversion: 2.1 time: 0.212755 Aug 22 11:07:59.572103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 250/494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:59 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:07:59.903544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:07:59.904595 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:07:59.911386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:59.911857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:59.912291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:07:59.913066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:07:59.913519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:07:59.913940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:00.046602 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:00.054636 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ce3dda0a-4ff9-4b9f-bf2e-49b2a778f1c5 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.154999 Aug 22 11:08:00.055247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 245/495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:07:59 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:00.333067 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-968013669", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "166e6798-7b1d-482e-a524-1940d4c8d177"}], "security_groups": [{"name": "tempest-securitygroup--1256436325"}], "key_name": "tempest-keypair-301855822", "user_data": "}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:00.436112 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] validate_networks() for [('166e6798-7b1d-482e-a524-1940d4c8d177', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:08:00.599084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:00.600002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:00.607977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:00.608689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:00.610153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:00.610913 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:00.611370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:00.612534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:00.759338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:00.769986 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4354de06-d11c-4a9b-919a-38dfb7396ca3 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1716 microversion: 2.1 time: 0.177901 Aug 22 11:08:00.770697 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 246/496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:00 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1716 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:00.849555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:08:00.849976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:08:00.850516 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:08:00.850951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:08:00.857748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:08:00.860931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:00.861766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:00.862208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:00.863010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:00.863465 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:00.864076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:00.881489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:08:00.887871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:08:00.902329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:00.903337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:00.910800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:08:00.913760 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:00.914581 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:00.914876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:08:00.915299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:00.916428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:00.917182 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:00.917856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.000932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] HTTP exception thrown: Cannot 'detach_volume' instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 while it is in vm_state rescued Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Request method failure captured: Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments/96914217-f278-4af0-9508-265b621791f4 HTTP/1.1 Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K4VPSfrEmSjxqKPp3GzLTG_GldlBtAqF8U7AEJ02UvMsGRiwjuhYgyZ7Mg3TCdeKVJE7oBebf3PBSTNyGQ3GyCvQznzFNRUA7OCBrgPh7oMsQ07BCVXzTNERgNF7JvChaLCeRTClI1YoV3HBTE0FXwpqtnGFn1THAE1P8dmPV3lkw Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:08:01.002447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2cb7651353884366b2ca72a7e272bdc0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 7c6fee0b956e41a7b2d9b914043633ea Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:08:01.004567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Cannot 'detach_volume' instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 while it is in vm_state rescued Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '790ba6d2-ada3-468b-bb51-1fca7bc7c349', 'id': '96914217-f278-4af0-9508-265b621791f4'} Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:08:01.005451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 while it is in vm_state rescued Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 while it is in vm_state rescued Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:01.006924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Returning 409 to user: Cannot 'detach_volume' instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 while it is in vm_state rescued {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:08:01.008435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dfac904b-1529-4e5d-bffa-38c03181bace tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments/96914217-f278-4af0-9508-265b621791f4" status: 409 len: 152 microversion: 2.1 time: 0.109400 Aug 22 11:08:01.008435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 247/497] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:08:00 2022] DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments/96914217-f278-4af0-9508-265b621791f4 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 11:08:01.013019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:01.013538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:01.019961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:01.020527 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:01.020962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.021647 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:01.022094 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:01.022564 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.027407 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7a162ba1-492f-49d0-ac48-3dd8c4f16a8d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698497 Aug 22 11:08:01.028171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 251/498] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:08:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:08:01.039030 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d72a5a0d-86e8-4752-8108-5f49474d7bbb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:01.039917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d72a5a0d-86e8-4752-8108-5f49474d7bbb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:01.098002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d72a5a0d-86e8-4752-8108-5f49474d7bbb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:01.104939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d72a5a0d-86e8-4752-8108-5f49474d7bbb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1240 microversion: 2.1 time: 0.069762 Aug 22 11:08:01.106797 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 252/499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:01 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:01.111841 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:01.112451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:01.119628 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:01.120228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:01.120548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.121259 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:01.121708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:01.122130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.240958 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-64419225-e9f4-4594-ae8f-416c8e67eb77 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "POST /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/action" status: 202 len: 0 microversion: 2.1 time: 0.231323 Aug 22 11:08:01.245835 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 248/500] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:08:01 2022] POST /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:08:01.251027 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:01.256155 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:01.259316 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:01.259937 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:01.260545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.261438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:01.262067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:01.262688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:01.266964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:01.275550 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-abf830c1-711a-4f7b-9615-5ba82912f805 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.167630 Aug 22 11:08:01.276559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 253/501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:01 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:01.397593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:01.406006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e66cd671-98ec-4afd-9a86-d26c7e173b4b tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.159923 Aug 22 11:08:01.406711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 249/502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:01 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:02.126214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:02.126787 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:02.133190 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:02.133661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:02.134099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:02.134788 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:02.135232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:02.135644 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:02.138192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:02.197195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:02.204907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0fae52c2-417e-464b-9d3d-6fd3cb96713d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1244 microversion: 2.1 time: 0.082547 Aug 22 11:08:02.205471 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 254/503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:02 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:02.297230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:02.297832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:02.304362 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:02.304844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:02.305275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:02.305953 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:02.306595 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:02.307022 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:02.427478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:02.428087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:02.433910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:02.434442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:02.434870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:02.435561 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:02.436010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:02.436259 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:02.436428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:02.444441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-edb430e5-bf78-46fd-9503-58a98a1e20a7 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.151074 Aug 22 11:08:02.445005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 250/504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:02 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:02.565251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:02.574878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e45ea5f8-cd77-4937-af62-570e1e4fabed tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.151348 Aug 22 11:08:02.575456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 255/505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:02 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:03.227967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:03.228584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:03.234805 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:03.235285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:03.235719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:03.236399 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:03.236849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:03.237270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:03.298096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:03.306640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-35618f7f-5ccc-4dcb-ac3b-44f0d965bfa9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1244 microversion: 2.1 time: 0.082457 Aug 22 11:08:03.307191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 251/506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:03 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:03.464875 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:03.465504 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:03.472000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:03.478423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:03.478423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:03.478423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:03.478423 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:03.478827 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:03.599276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:03.600188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:03.610084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:03.610788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:03.611461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:03.612765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:03.614105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:03.614858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:03.623658 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:03.636456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dde8f7c6-212d-4eef-9b32-5ecc179eb651 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.175236 Aug 22 11:08:03.637500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 256/507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:03 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:03.846652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:03.856850 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a431c02a-ea19-4051-9548-5b29f02213a9 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.264149 Aug 22 11:08:03.858049 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 252/508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:03 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:04.327543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:04.328070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:04.334254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:04.334771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:04.335232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:04.336009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:04.336462 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:04.336882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:04.400287 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:04.407983 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e7dc51f2-fc3b-4cc4-a16b-857d31797c4f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1292 microversion: 2.1 time: 0.084652 Aug 22 11:08:04.408548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 257/509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:04 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:04.657111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:04.657628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:04.664594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:04.665074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:04.665507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:04.666186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:04.666659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:04.667077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:04.792557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:04.800034 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f9aa53c7-509d-481b-9479-6e2609d23bdd tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.146858 Aug 22 11:08:04.801323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 253/510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:04 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:04.883943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:04.884547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:04.890980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:04.891438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:04.891864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:04.892542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:04.892988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:04.893404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:05.021874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:05.030075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-26ca11c3-b327-43e6-9abf-9b06176e4838 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.149907 Aug 22 11:08:05.030668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 258/511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:04 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:05.432931 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:05.433542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:05.439505 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:05.439979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:05.440407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:05.441085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:05.441655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:05.442285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:05.504380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:05.511985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4e74ac93-2848-4599-9212-42ca6e411ebe tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1300 microversion: 2.1 time: 0.082880 Aug 22 11:08:05.513607 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 254/512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:05 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:05.820974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:05.821607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:05.827544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:05.828023 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:05.828453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:05.829135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:05.829583 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:05.830004 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:05.963616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:05.971131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8f625e86-768c-4bd3-9caa-785822729d38 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.154017 Aug 22 11:08:05.971694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 259/513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:05 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:06.051124 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:06.052560 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:06.058982 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:06.059461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:06.059896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:06.060582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:06.061036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:06.061460 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:06.192621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:06.200882 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8d9a6aae-6d33-4864-80fb-80d8df383a14 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.153559 Aug 22 11:08:06.201447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 255/514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:06 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:06.532061 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:06.532668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:06.539266 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:06.539744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:06.540173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:06.540852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:06.541299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:06.541718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:06.602725 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:06.610718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b95ea9f1-c557-4bd2-bab2-5b6492b9e7bb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1300 microversion: 2.1 time: 0.082537 Aug 22 11:08:06.611251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 260/515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:06 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:06.993374 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:06.993975 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:07.000096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:07.000579 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:07.001008 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:07.001685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:07.002129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:07.002585 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:07.129848 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:07.132238 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:07.138181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-26eb9a93-b08c-4b7d-86c2-ab04f8250fce tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.149262 Aug 22 11:08:07.138764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 256/516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:06 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:07.221960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:07.223266 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:07.230774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:07.231525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:07.231962 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:07.232674 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:07.233143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:07.233552 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:07.369650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:07.377904 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b5f9bf61-5fe0-43a5-81d5-5b7216ae1f18 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.159744 Aug 22 11:08:07.378506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 261/517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:07 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:07.632239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:07.632732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:07.639551 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:07.640044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:07.640473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:07.641172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:07.641626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:07.642048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:07.685924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:07.707412 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:07.715638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-29e3d1cc-02f4-4276-8f35-39dde1129465 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1310 microversion: 2.1 time: 0.088046 Aug 22 11:08:07.716209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 257/518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:07 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:08.158253 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:08.158868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:08.165489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:08.165953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:08.166420 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:08.167109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:08.167563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:08.167988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:08.301099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:08.309299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-96502f81-d4d1-4140-81e8-e5e5d8df192d tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.154944 Aug 22 11:08:08.309850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 262/519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:08 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:08.399074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:08.399773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:08.407068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:08.407558 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:08.412174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:08.412174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:08.412174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:08.412174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:08.545760 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:08.554948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ced003bb-f6ab-4bf7-8bd8-9306ad0ab55e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.159539 Aug 22 11:08:08.555615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 258/520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:08 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:08.737197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:08.737721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:08.748472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:08.749015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:08.749455 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:08.750162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:08.750648 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:08.751092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:08.815082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:08.823111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e2481413-8d97-483e-9cf2-e69944e05146 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1310 microversion: 2.1 time: 0.090091 Aug 22 11:08:08.823743 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 263/521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:08 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:09.330331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:09.330945 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:09.337764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:09.338305 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:09.338761 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:09.339455 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:09.339909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:09.340332 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:09.533320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:09.542010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97e6378d-a7aa-4551-9d60-dcbb480f0c9e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.215555 Aug 22 11:08:09.542599 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 259/522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:09 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:09.576733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:09.577396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:09.585141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:09.585622 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:09.586047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:09.587001 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:09.587205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:09.587627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:09.723249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:09.734430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d80b7f58-edcd-44e8-a399-5b44359ad5cd tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.161400 Aug 22 11:08:09.735019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 264/523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:09 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:09.844611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:09.845153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:09.851908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:09.852421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:09.852859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:09.853548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:09.854000 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:09.854452 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:09.984392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:09.992292 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8be7bc03-09dc-4e44-b7de-8f80a3539418 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.151621 Aug 22 11:08:09.993119 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 260/524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:09 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:10.562747 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:10.563351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:10.569530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:10.570011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:10.570467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:10.571149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:10.571592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:10.572008 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:10.756859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:10.757505 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:10.764569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:10.765079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:10.765520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:10.766249 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:10.766709 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:10.767137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:10.872929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:10.915580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:10.924489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b12b5b88-c2ab-4835-abb9-2bd7cc5915ea tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.172355 Aug 22 11:08:10.930460 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 261/525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:10 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:10.934085 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:10.941606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2fb02999-a197-4ab1-afaa-337f7cef8596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.382716 Aug 22 11:08:10.942183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 265/526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:10 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:11.013615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:11.014248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:11.020202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:11.020673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:11.021767 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:11.022494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:11.022940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:11.023387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:11.152978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:11.160547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7079ab65-6ca9-4aa5-8e2d-c04256d673a9 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.150765 Aug 22 11:08:11.161105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 262/527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:11 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:11.946724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:11.947547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:11.950981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=8 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:11.963073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-626bae35-3771-49f7-9492-b4af9da42ae1 req-bf318d03-3771-4d72-89d5-81f88cdf1032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "name": "network-vif-plugged", "status": "completed", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:11.972354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:11.978280 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:11.979776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:11.981404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:11.982324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:11.985775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-626bae35-3771-49f7-9492-b4af9da42ae1 req-bf318d03-3771-4d72-89d5-81f88cdf1032 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:11.986411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:11.990881 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-626bae35-3771-49f7-9492-b4af9da42ae1 req-bf318d03-3771-4d72-89d5-81f88cdf1032 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:11.991326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-626bae35-3771-49f7-9492-b4af9da42ae1 req-bf318d03-3771-4d72-89d5-81f88cdf1032 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:12.009063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-626bae35-3771-49f7-9492-b4af9da42ae1 req-bf318d03-3771-4d72-89d5-81f88cdf1032 service nova] Creating event network-vif-plugged:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:08:12.014665 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-626bae35-3771-49f7-9492-b4af9da42ae1 req-bf318d03-3771-4d72-89d5-81f88cdf1032 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056619 Aug 22 11:08:12.017216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 263/528] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:08:12.022033 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:12.023002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:12.029464 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:12.030201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:12.030670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:12.031364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:12.031817 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:12.032422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:12.139278 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:12.148547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8434a294-e47e-4532-a18c-bea2c130dbc4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1724 microversion: 2.1 time: 0.205848 Aug 22 11:08:12.149454 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 266/529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:11 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:12.183235 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:12.183858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:12.189774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:12.190286 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:12.190731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:12.191433 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:12.191889 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:12.192318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:12.267280 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:12.276707 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-af9b3804-cd8c-4af1-9793-762b81efb91e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.259683 Aug 22 11:08:12.282264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 264/530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:12 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:12.331252 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:12.339575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-db7055d1-7eb2-49ea-af2b-66f1b2c8b868 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.160197 Aug 22 11:08:12.340145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 267/531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:12 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:12.677382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-459e8fe0-811c-47e9-a21b-eabcce6ccaa4 req-fab659f6-9739-40e1-9602-b8d2f4b63f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97645244-c78b-40be-82b1-fb4e66a5eaaf", "tag": "281fcf26-5e01-4ab8-b0de-af97ac611bdc"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:12.687738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-459e8fe0-811c-47e9-a21b-eabcce6ccaa4 req-fab659f6-9739-40e1-9602-b8d2f4b63f2b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:12.688384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-459e8fe0-811c-47e9-a21b-eabcce6ccaa4 req-fab659f6-9739-40e1-9602-b8d2f4b63f2b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:12.692306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-459e8fe0-811c-47e9-a21b-eabcce6ccaa4 req-fab659f6-9739-40e1-9602-b8d2f4b63f2b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:12.700307 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-459e8fe0-811c-47e9-a21b-eabcce6ccaa4 req-fab659f6-9739-40e1-9602-b8d2f4b63f2b service nova] Creating event network-changed:281fcf26-5e01-4ab8-b0de-af97ac611bdc for instance 97645244-c78b-40be-82b1-fb4e66a5eaaf on hv-cinder-85394 Aug 22 11:08:12.705310 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-459e8fe0-811c-47e9-a21b-eabcce6ccaa4 req-fab659f6-9739-40e1-9602-b8d2f4b63f2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033202 Aug 22 11:08:12.706131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 265/532] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:13.169641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:13.170335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:13.177070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.177556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.177989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.179408 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.179857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.180284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.297461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:13.298152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:13.305083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.305561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.305993 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.306772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.307199 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.312042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.324876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:13.333028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0f3b09be-d316-4f7f-9a6c-e20f6b5450cb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1730 microversion: 2.1 time: 0.167315 Aug 22 11:08:13.333597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 268/533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:13 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:13.359488 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:13.360181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:13.366250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.366738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.367165 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.367884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.368339 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.368757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.441403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:13.446444 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8cd25aec-dc4f-4fbb-bc2b-94b18bbe0932 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091107 Aug 22 11:08:13.447126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 269/534] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:08:13 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:08:13.449665 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-74c59235-518a-4a77-8e72-48e3eb2b5b16 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.156237 Aug 22 11:08:13.450416 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 266/535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:13 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:13.452089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:13.452774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:13.459123 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.460214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.460719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.461480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:13.461994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:13.462599 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:13.593009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:13.601865 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2cc66792-1012-437c-b885-8567cbe5b2e7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.153443 Aug 22 11:08:13.602474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 270/536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:13 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:14.461747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:14.462334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:14.469286 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.470088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.470206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.470943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.471405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.471728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:14.472146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.472343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:14.482033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.483131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.483844 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.485123 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.485736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.486376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.504239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e93e922b-a87b-4ebc-808f-fe40786189d2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments/5365a963-b320-4048-931b-e306c3951c7c" status: 200 len: 194 microversion: 2.20 time: 0.046505 Aug 22 11:08:14.505005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 267/537] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Aug 22 11:08:14 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments/5365a963-b320-4048-931b-e306c3951c7c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:08:14.507286 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:14.588338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:14.588338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:14.591321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.591877 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.592480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.593329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.593934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.594553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.646821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:14.656189 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-945df0ce-167e-45d9-85be-d762c68d0e70 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1358 microversion: 2.1 time: 0.188435 Aug 22 11:08:14.669863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 271/538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:14 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:14.669863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:14.669863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:14.669863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.675999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.675999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.675999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.675999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.676343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.701954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lazy-loading 'services' on Instance uuid 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:08:14.833999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:14.843547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3c1296c8-e25c-4cb2-9013-172449456aba tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.185231 Aug 22 11:08:14.844110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 272/539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:14 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:14.915725 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-d311e50e-e15e-4590-b4e8-bb05b2dd0a65 req-ed96b27b-49a9-4ae7-8696-2abead1e60ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790ba6d2-ada3-468b-bb51-1fca7bc7c349", "tag": "ae8855e3-0bba-4105-b7f6-23b967086d90"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:14.916573 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-88841291-0e49-4247-aeb3-bcfca0bc5012 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments/5365a963-b320-4048-931b-e306c3951c7c" status: 202 len: 0 microversion: 2.20 time: 0.336778 Aug 22 11:08:14.923668 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 268/540] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 22 11:08:14 2022] DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments/5365a963-b320-4048-931b-e306c3951c7c => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:08:14.926927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:14.929689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:14.930028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d311e50e-e15e-4590-b4e8-bb05b2dd0a65 req-ed96b27b-49a9-4ae7-8696-2abead1e60ae service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.930562 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d311e50e-e15e-4590-b4e8-bb05b2dd0a65 req-ed96b27b-49a9-4ae7-8696-2abead1e60ae service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.930984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d311e50e-e15e-4590-b4e8-bb05b2dd0a65 req-ed96b27b-49a9-4ae7-8696-2abead1e60ae service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.936954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.937647 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.938263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.938966 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:14.939570 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:14.940263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:14.950478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-d311e50e-e15e-4590-b4e8-bb05b2dd0a65 req-ed96b27b-49a9-4ae7-8696-2abead1e60ae service nova] Creating event network-changed:ae8855e3-0bba-4105-b7f6-23b967086d90 for instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 on hv-cinder-85394 Aug 22 11:08:14.954125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-d311e50e-e15e-4590-b4e8-bb05b2dd0a65 req-ed96b27b-49a9-4ae7-8696-2abead1e60ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043020 Aug 22 11:08:14.955141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 273/541] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:14.976559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0d7bd868-cde3-48f3-bb71-2cb747a61d8f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054783 Aug 22 11:08:14.977111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 269/542] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 22 11:08:14 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 11:08:15.678132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:15.679551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:15.685643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:15.686123 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:15.686582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:15.687277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:15.687727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:15.688148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:15.844593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:15.852776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6962656c-906a-471a-b912-1a450e478f31 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1549 microversion: 2.1 time: 0.179369 Aug 22 11:08:15.853352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 274/543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:15 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:15.872206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:15.872845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:15.874981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:15.875595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:15.879512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:15.879995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:15.880457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:15.881150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:15.881390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:15.881672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:15.881963 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:15.882432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:15.882543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:15.883133 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:15.883589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:15.884012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.016661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:16.017319 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:16.025001 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-de2f8a5e-5871-445f-bbae-5d9d5f3ab80e tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1549 microversion: 2.1 time: 0.153730 Aug 22 11:08:16.025686 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 275/544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:15 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:16.026653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8de9b495-6aa0-4659-b08a-5d4c8572b863 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.158243 Aug 22 11:08:16.038257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:16.038257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:16.038744 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 270/545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:15 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:16.045063 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.045810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:16.045962 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.046528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.047322 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.047873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.048393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.050503 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:16.051169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Searching by: {'deleted': False, 'project_id': '0533d69c876f4cbdbf6b7138abf37893'} {{(pid=121142) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 11:08:16.058886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.059365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.059903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.060634 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.061086 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.061502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.081777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-196d4e09-43c9-4e6d-8b29-fb2a83c54f6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054963 Aug 22 11:08:16.082585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 276/546] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 22 11:08:16 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:08:16.169329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.multi_cell_list [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121142) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 11:08:16.240196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:16.241428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:16.247190 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.247672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.248131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.248814 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.249261 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.249677 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.275591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-262469c2-0893-496a-9cb9-1b1de21ded30 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.233479 Aug 22 11:08:16.276173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 271/547] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Aug 22 11:08:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:16.287222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:16.288010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:16.289915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:16.294680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.295160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.295638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.299946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.299946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.299946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.377981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lazy-loading 'services' on Instance uuid 56537f93-1161-4c2c-8f08-9d1e54c3d178 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:08:16.430720 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:16.438449 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2cc6ff29-9c77-4135-b989-eec0c04311ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1549 microversion: 2.1 time: 0.154901 Aug 22 11:08:16.439005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 272/548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:16 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:16.592913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7fc41dbf-980f-4642-96e9-3e053b929c68 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178/os-volume_attachments/4842e3ac-147d-45da-bb7b-0d1715674509" status: 202 len: 0 microversion: 2.1 time: 0.358903 Aug 22 11:08:16.593794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 277/549] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:08:16 2022] DELETE /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178/os-volume_attachments/4842e3ac-147d-45da-bb7b-0d1715674509 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:08:16.973454 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-a2fba023-c2ac-4d56-9b65-c5ce6c57e371 req-5e95118b-ea9a-4707-9d69-828a10d20e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790ba6d2-ada3-468b-bb51-1fca7bc7c349", "tag": "ae8855e3-0bba-4105-b7f6-23b967086d90"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:16.983795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a2fba023-c2ac-4d56-9b65-c5ce6c57e371 req-5e95118b-ea9a-4707-9d69-828a10d20e34 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:16.984275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a2fba023-c2ac-4d56-9b65-c5ce6c57e371 req-5e95118b-ea9a-4707-9d69-828a10d20e34 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:16.984700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a2fba023-c2ac-4d56-9b65-c5ce6c57e371 req-5e95118b-ea9a-4707-9d69-828a10d20e34 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:16.996717 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-a2fba023-c2ac-4d56-9b65-c5ce6c57e371 req-5e95118b-ea9a-4707-9d69-828a10d20e34 service nova] Creating event network-changed:ae8855e3-0bba-4105-b7f6-23b967086d90 for instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 on hv-cinder-85394 Aug 22 11:08:17.013417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-a2fba023-c2ac-4d56-9b65-c5ce6c57e371 req-5e95118b-ea9a-4707-9d69-828a10d20e34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043628 Aug 22 11:08:17.019297 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 273/550] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:17.050035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:17.050743 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:17.061877 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:17.062551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:17.063004 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:17.073023 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:17.074832 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:17.080207 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:17.095142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:17.098043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:17.107869 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:17.108619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:17.109857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:17.110878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:17.111544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:17.112201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:17.128508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:17.154305 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54868813-0bd4-4ba6-b8c9-2d41eb1ffe80 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063500 Aug 22 11:08:17.168092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 274/551] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 22 11:08:17 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:08:17.247032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:17.254871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3e6c8a27-e5cc-4f71-92b9-99e35cdf242f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.209852 Aug 22 11:08:17.255474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 278/552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:17 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:18.168229 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:18.170259 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:18.177448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.177935 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.179891 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.180616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.181073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.181499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.213252 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d18a2cb-a850-4dd2-a5a9-2989c4546427 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049484 Aug 22 11:08:18.213813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 275/553] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 22 11:08:18 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:18.277473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:18.278006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:18.278006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:18.278222 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:18.283787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.284267 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.284698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.285530 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.285985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.286111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.286510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.286659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.287000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.288674 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.289244 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.289785 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.314603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:08:18.426406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:18.435263 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ca7b4bbd-c75b-4876-9efb-bf9822761094 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.161612 Aug 22 11:08:18.435986 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 279/554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:18 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:18.440720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:18.443410 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:18.449955 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.450487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.450922 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.451748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.452199 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.452620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.574617 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ed49b05c-0346-46ff-80aa-910656bae423 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 204 len: 0 microversion: 2.20 time: 0.300586 Aug 22 11:08:18.575201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 276/555] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 22 11:08:18 2022] DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 11:08:18.583496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:18.584139 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:18.590663 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.591137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.591563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.592253 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.592794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.593213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.722694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:18.731008 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:18.732763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:18.733914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8ab0b773-26b6-4265-aa7f-bb850e3e958a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.154441 Aug 22 11:08:18.734482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 277/556] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:18 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:08:18.786571 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:18.787068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:18.793062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.793538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.793973 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.794689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:18.795148 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:18.795571 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:18.822588 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:08:19.071036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a805c102-bccc-4475-ad50-d0b602fdea46 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 204 len: 0 microversion: 2.1 time: 0.288023 Aug 22 11:08:19.071641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 278/557] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:08:18 2022] DELETE /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:08:19.079960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:19.080644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:19.086525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.087001 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.087433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.088187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.088643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.089061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.227440 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:19.235345 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1dfdc223-2a1c-49f2-a9fa-77b4ecd408c9 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1512 microversion: 2.1 time: 0.159221 Aug 22 11:08:19.235901 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 279/558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:19 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:19.456825 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:19.457349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:19.464046 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.464522 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.464950 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.465657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.466115 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.466562 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.594141 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:19.601696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-29ab28ae-11cf-4e36-a5cb-39be2e0afe8a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.148845 Aug 22 11:08:19.602282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 280/559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:19 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:19.756909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:19.758044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:19.763938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.764426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.764864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.765617 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.766031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.766486 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.895726 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:19.904493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:19.909269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:19.909269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2f182de8-f793-413e-a997-7f73c6157b58 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.154205 Aug 22 11:08:19.909269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 281/560] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:19 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:08:19.959041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-02108842-d8b3-4396-a2f9-bd8332704d34 req-1420f356-c403-495e-87ef-9ea4d027631c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97645244-c78b-40be-82b1-fb4e66a5eaaf", "name": "network-vif-plugged", "status": "completed", "tag": "281fcf26-5e01-4ab8-b0de-af97ac611bdc"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:19.969290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-02108842-d8b3-4396-a2f9-bd8332704d34 req-1420f356-c403-495e-87ef-9ea4d027631c service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:19.969783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-02108842-d8b3-4396-a2f9-bd8332704d34 req-1420f356-c403-495e-87ef-9ea4d027631c service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:19.970208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-02108842-d8b3-4396-a2f9-bd8332704d34 req-1420f356-c403-495e-87ef-9ea4d027631c service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:19.981091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-02108842-d8b3-4396-a2f9-bd8332704d34 req-1420f356-c403-495e-87ef-9ea4d027631c service nova] Creating event network-vif-plugged:281fcf26-5e01-4ab8-b0de-af97ac611bdc for instance 97645244-c78b-40be-82b1-fb4e66a5eaaf on hv-cinder-85394 Aug 22 11:08:19.986268 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-02108842-d8b3-4396-a2f9-bd8332704d34 req-1420f356-c403-495e-87ef-9ea4d027631c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031084 Aug 22 11:08:19.986836 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 282/561] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:08:20.257711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:20.258548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:20.264604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:20.265077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:20.265548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:20.266247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:20.266690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:20.267106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:20.402163 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:20.410069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7796b8fb-4dbd-418a-845d-001a6c789831 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1512 microversion: 2.1 time: 0.156672 Aug 22 11:08:20.410667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 283/562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:20 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:20.464748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2565d48b-9200-4e71-a133-2f8207e279cc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.027407 Aug 22 11:08:20.465361 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 280/563] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:08:18 2022] POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments => generated 194 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:20.622923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:20.623453 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:20.629207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:20.629700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:20.630107 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:20.630802 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:20.631245 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:20.631656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:20.759662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:20.767261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e6cbb35-b35c-4413-a610-3c1c7c8401ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.148415 Aug 22 11:08:20.767816 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 284/564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:20 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:20.933634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:20.934278 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:20.940388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:20.940868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:20.941298 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:20.941985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:20.942463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:20.942883 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:21.074735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:21.082855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:21.084362 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:21.085510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cf97d3c8-e78e-48e3-b049-052d28acfba0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.156834 Aug 22 11:08:21.086068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 281/565] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:20 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:21.431970 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:21.432580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:21.439208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:21.439684 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:21.440117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:21.440801 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:21.441254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:21.441675 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:21.589374 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:21.599213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68c93824-90fe-4b2c-8241-4f192466289c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1512 microversion: 2.1 time: 0.171789 Aug 22 11:08:21.599789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 285/566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:21 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:21.787655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:21.788265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:21.795140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:21.795618 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:21.796050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:21.796736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:21.797187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:21.797606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:21.935469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:21.943647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-09741e86-c9eb-430f-843a-50c73b655afa tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.159772 Aug 22 11:08:21.949136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 282/567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:21 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:22.109596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:22.110046 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:22.115998 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:22.116481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:22.116913 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:22.117597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:22.118045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:22.118495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:22.421897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:22.429892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:22.431928 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:22.433082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-57d48c09-b100-481a-81b2-f4121e0a8c11 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1723 microversion: 2.20 time: 0.328245 Aug 22 11:08:22.433669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 286/568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:22 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:08:22.622034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:22.622607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:22.629843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:22.630565 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:22.631133 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:22.631832 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:22.632548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:22.644240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:22.781283 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:22.789733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-10b1e4ff-eb2a-4367-aefc-df1996c61424 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1512 microversion: 2.1 time: 0.173273 Aug 22 11:08:22.799338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 283/569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:22 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:22.965288 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:22.965891 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:22.973627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:22.974105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:22.974567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:22.975411 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:22.975887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:22.976308 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:23.445711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-8fd072c0-db21-4f1c-b558-82a1e3595e0d req-9e5ae002-7efb-4eb3-805d-6232c2e9d69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56537f93-1161-4c2c-8f08-9d1e54c3d178", "name": "network-vif-deleted", "tag": "25f323f3-4e21-40c9-bf02-8ab84a7f76d3"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:23.451623 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-8fd072c0-db21-4f1c-b558-82a1e3595e0d req-9e5ae002-7efb-4eb3-805d-6232c2e9d69d service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:23.452286 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-8fd072c0-db21-4f1c-b558-82a1e3595e0d req-9e5ae002-7efb-4eb3-805d-6232c2e9d69d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:23.452702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-8fd072c0-db21-4f1c-b558-82a1e3595e0d req-9e5ae002-7efb-4eb3-805d-6232c2e9d69d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:23.467131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-8fd072c0-db21-4f1c-b558-82a1e3595e0d req-9e5ae002-7efb-4eb3-805d-6232c2e9d69d service nova] Creating event network-vif-deleted:25f323f3-4e21-40c9-bf02-8ab84a7f76d3 for instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 on hv-cinder-85394 Aug 22 11:08:23.472947 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-8fd072c0-db21-4f1c-b558-82a1e3595e0d req-9e5ae002-7efb-4eb3-805d-6232c2e9d69d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041769 Aug 22 11:08:23.473731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 284/570] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:23.480198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:23.481093 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:23.487435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:23.489132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:23.489646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:23.490039 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:23.490750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:23.491196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:23.491652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:23.520049 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:23.529537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d19f432b-0657-44d3-8572-d2fb6aa9272f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1366 microversion: 2.1 time: 0.568253 Aug 22 11:08:23.530056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 287/571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:22 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1366 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:23.570608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:23.580773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:23.582821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:23.584200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-13296645-e9ef-4bac-9bae-58983881421d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1655 microversion: 2.20 time: 0.109045 Aug 22 11:08:23.584907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 285/572] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:23 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:23.812927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:23.813675 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:23.821695 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:23.824214 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:23.824977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:23.825905 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:23.826596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:23.828386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:23.848393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:23.910112 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:23.918510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c43b0336-fba3-4138-8aa0-9a437dae2613 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 200 len: 1303 microversion: 2.1 time: 0.109449 Aug 22 11:08:23.919482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 288/573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:23 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:24.552855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:24.553495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:24.560459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.560938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.561371 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.562052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.562522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.562945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.610140 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:24.610925 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:24.617202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.617769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.618306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.619291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.619839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.620492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.656456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.656952 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.657387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.657843 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lazy-loading 'fault' on Instance uuid 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:08:24.703216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:24.711675 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b84e323f-335e-4309-a6d8-5e17d016adb6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1556 microversion: 2.1 time: 0.162577 Aug 22 11:08:24.713359 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 286/574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:24 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:24.729131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:24.734547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:24.735089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:24.738735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:24.742608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.742608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.742969 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.743623 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.745349 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.745807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.746657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:24.748918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0b5d837a-1889-485c-b56f-ff6b13eec856 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 200 len: 1371 microversion: 2.20 time: 0.143566 Aug 22 11:08:24.749034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:24.756154 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 289/575] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:24 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:24.836542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-02803339-9a82-47f1-a41a-09850badcc8e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106238 Aug 22 11:08:24.837136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 287/576] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:08:24 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:24.940159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:24.940827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 56537f93-1161-4c2c-8f08-9d1e54c3d178] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:24.946770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.947818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.948285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.949108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:24.949553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:24.949977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:24.964304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] HTTP exception thrown: Instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 could not be found. Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Request method failure captured: Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 HTTP/1.1 Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2NVeZhkNdOx-YDiCUapWwBrBjHTRPM8bhrKIOGJ_3TP0DYuqPAG4vd1MHhqwmOzuBZkTBwDIXSvRDzS1EWUnn37SadVIxP9fzVl2itbAJIfXYQwHe_op6BF2JxvWL9grvvgZzGpQXosr7J06TgW-0r7TjHTbu3U7tUnK4Y9P6OFoVA Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 2fa4a05673a14d1195ca2066b57a6cb8 Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1980603323 Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:08:24.965924 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2fa4a05673a14d1195ca2066b57a6cb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2fa4a05673a14d1195ca2066b57a6cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2fa4a05673a14d1195ca2066b57a6cb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2fa4a05673a14d1195ca2066b57a6cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotTestJSON-1980603323 Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 2fa4a05673a14d1195ca2066b57a6cb8 Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1980603323 Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotTestJSON-1980603323-project Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 270a3d73e04941a4b410b3e22043db9b Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotTestJSON-1980603323-project Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 could not be found. Aug 22 11:08:24.971051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '56537f93-1161-4c2c-8f08-9d1e54c3d178'} Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 could not be found. Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:08:24.972041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 could not be found. Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 could not be found. Aug 22 11:08:24.973320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:24.974682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Returning 404 to user: Instance 56537f93-1161-4c2c-8f08-9d1e54c3d178 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:08:24.974682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c2d1f8b9-cc0d-4b8b-bac8-95172fb4593e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178" status: 404 len: 111 microversion: 2.1 time: 0.031476 Aug 22 11:08:24.974682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 290/577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:24 2022] GET /compute/v2.1/servers/56537f93-1161-4c2c-8f08-9d1e54c3d178 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:08:25.489796 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-4bf534cc-9b9e-4dfd-9ac0-bbea5a5f6c8b req-47dba44d-15ee-4444-9589-2809fa1e19ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7473dbdb-b8d3-4481-86b9-75fd3e260bc1", "name": "network-vif-deleted", "tag": "a803b421-9e13-43cc-9642-64ae33731b41"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:25.500069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-4bf534cc-9b9e-4dfd-9ac0-bbea5a5f6c8b req-47dba44d-15ee-4444-9589-2809fa1e19ec service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:25.500539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-4bf534cc-9b9e-4dfd-9ac0-bbea5a5f6c8b req-47dba44d-15ee-4444-9589-2809fa1e19ec service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:25.502849 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-4bf534cc-9b9e-4dfd-9ac0-bbea5a5f6c8b req-47dba44d-15ee-4444-9589-2809fa1e19ec service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:25.513871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-4bf534cc-9b9e-4dfd-9ac0-bbea5a5f6c8b req-47dba44d-15ee-4444-9589-2809fa1e19ec service nova] Creating event network-vif-deleted:a803b421-9e13-43cc-9642-64ae33731b41 for instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 on hv-cinder-85394 Aug 22 11:08:25.518750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-4bf534cc-9b9e-4dfd-9ac0-bbea5a5f6c8b req-47dba44d-15ee-4444-9589-2809fa1e19ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Aug 22 11:08:25.519338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 288/578] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:08:25.772130 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:25.772742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:25.779866 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:25.780354 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:25.780794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:25.781501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:25.781954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:25.782433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:25.795888 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] HTTP exception thrown: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Request method failure captured: Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 HTTP/1.1 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K5Qx3rx1BO89BRNw4DYHm3sCADvg0mfguiQ1UktfBM3zMWlibYZpBpl-PKqN37xTe9fsUxRGw1tYUFt_9mLOZ_xFnR9IZD6NhWvL3a61EcJAmdCO3TGhwYp5Lpkev6CnlhSYN61qCfPWVQ2TDqlOGOGXdHLafPbCrbuWWKKk00_EY Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:08:25.797424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_629e8810bbcb4623bcd6b6aee8f7dbb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: d13b7df898df4d238ea290fab8edc4a7 Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:08:25.798903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '7473dbdb-b8d3-4481-86b9-75fd3e260bc1'} Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:08:25.799673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:08:25.800787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:08:25.801908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Returning 404 to user: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:08:25.801908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2dc2d101-33d3-4d41-8ad0-b9b32a92e76a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 404 len: 111 microversion: 2.20 time: 0.030699 Aug 22 11:08:25.801908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 291/579] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:25 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:08:25.809147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-039864d3-5df3-46d6-a299-f1d6deb93a0e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '.version_select at 0x7f3b4c705ee0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:25.891225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-039864d3-5df3-46d6-a299-f1d6deb93a0e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-906534526" status: 204 len: 0 microversion: 2.20 time: 0.086976 Aug 22 11:08:25.894350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 289/580] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Aug 22 11:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-906534526 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 11:08:25.904144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-939e0abc-12ae-4593-a727-d6a6e8cda633 req-abb906e0-2a32-4195-85a3-4f19a337fcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97645244-c78b-40be-82b1-fb4e66a5eaaf", "tag": "281fcf26-5e01-4ab8-b0de-af97ac611bdc"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:25.913786 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-939e0abc-12ae-4593-a727-d6a6e8cda633 req-abb906e0-2a32-4195-85a3-4f19a337fcb2 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:25.920064 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-939e0abc-12ae-4593-a727-d6a6e8cda633 req-abb906e0-2a32-4195-85a3-4f19a337fcb2 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:25.920064 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-939e0abc-12ae-4593-a727-d6a6e8cda633 req-abb906e0-2a32-4195-85a3-4f19a337fcb2 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:25.927534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-939e0abc-12ae-4593-a727-d6a6e8cda633 req-abb906e0-2a32-4195-85a3-4f19a337fcb2 service nova] Creating event network-changed:281fcf26-5e01-4ab8-b0de-af97ac611bdc for instance 97645244-c78b-40be-82b1-fb4e66a5eaaf on hv-cinder-85394 Aug 22 11:08:25.934835 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-939e0abc-12ae-4593-a727-d6a6e8cda633 req-abb906e0-2a32-4195-85a3-4f19a337fcb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034991 Aug 22 11:08:25.937548 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 292/581] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:26.704194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ef09a65a-6096-4c5f-b574-e844c4299713 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'create', calling method: .version_select at 0x7f3b4c7badc0>, body: {"keypair": {"name": "tempest-keypair-966136140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdefdMYPtpca0KZ+nU76qwW7ihinhrJZ2/WIdsL3Uqb4mBLSDMcNGYNQ3q3ZuBXRuGaAojTziu2gzusMgUQQKCwPSt9ukIag9YJ+ohBZIWYaomnl3h7x2npAL4WQU2xIg=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:26.720956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-ef09a65a-6096-4c5f-b574-e844c4299713 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:08:26.725172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-ef09a65a-6096-4c5f-b574-e844c4299713 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for user d13b7df898df4d238ea290fab8edc4a7 and project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:08:26.781893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ef09a65a-6096-4c5f-b574-e844c4299713 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.081650 Aug 22 11:08:26.782532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 290/582] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 22 11:08:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 11:08:28.928956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:28.934991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1530122569", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1774e836-6324-4a7b-a06f-afa9bfeb3924"}], "security_groups": [{"name": "tempest-securitygroup--352334814"}], "key_name": "tempest-keypair-966136140", "user_data": "}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:29.042681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] validate_networks() for [('1774e836-6324-4a7b-a06f-afa9bfeb3924', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:08:29.559206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:08:29.559680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:08:29.560151 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:08:29.560550 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:08:29.560952 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:08:29.569563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:29.570034 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:29.570495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:29.571225 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:29.571648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:29.572061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:29.590885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:08:29.603674 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Getting quotas for user d13b7df898df4d238ea290fab8edc4a7 and project 629e8810bbcb4623bcd6b6aee8f7dbb9. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:08:29.616307 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:08:29.618716 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:08:29.742367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ceaccb43-bd88-4f7a-9894-e84fc81c4077 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.814239 Aug 22 11:08:29.743016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 293/583] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 22 11:08:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 11:08:29.754880 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-05fe5bae-7401-4b5b-90a0-943df2fb345e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:29.760883 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-05fe5bae-7401-4b5b-90a0-943df2fb345e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:29.818963 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-05fe5bae-7401-4b5b-90a0-943df2fb345e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:29.823667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-05fe5bae-7401-4b5b-90a0-943df2fb345e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:29.825962 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-05fe5bae-7401-4b5b-90a0-943df2fb345e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:29.827839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-05fe5bae-7401-4b5b-90a0-943df2fb345e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1281 microversion: 2.20 time: 0.076783 Aug 22 11:08:29.828421 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 291/584] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:29 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:30.237709 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:30.238381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:30.244695 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:30.245330 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:30.245766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:30.246883 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:30.247342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:30.247762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:30.383460 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:30.391625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e58d6b82-045b-4e55-beed-e68144fc9596 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1595 microversion: 2.1 time: 0.158860 Aug 22 11:08:30.392192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 294/585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:30 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:30.855803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:30.856989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:30.865539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:30.868471 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:30.868471 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:30.868471 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:30.868471 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:30.869974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:30.951041 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:30.959953 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:30.961524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:30.962671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-970afeba-dec6-4275-9b36-e20bbd1d217a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1285 microversion: 2.20 time: 0.112346 Aug 22 11:08:30.963843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 292/586] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:30 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:31.987413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:31.988026 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:31.995497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:31.995991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:31.997489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:31.997833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:31.998315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:31.998739 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:32.069286 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:32.078290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:32.079800 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:32.080940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ae932333-7127-4eac-8e9e-0b03078951d8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1341 microversion: 2.20 time: 0.097495 Aug 22 11:08:32.081503 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 295/587] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:31 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:32.629412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-ad5d2744-dd88-4955-91b9-d0301b4ce955 req-ec3c38a2-f7b1-486f-93a2-92b42889a0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:32.640150 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-ad5d2744-dd88-4955-91b9-d0301b4ce955 req-ec3c38a2-f7b1-486f-93a2-92b42889a0f9 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:32.640997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-ad5d2744-dd88-4955-91b9-d0301b4ce955 req-ec3c38a2-f7b1-486f-93a2-92b42889a0f9 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:32.641176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-ad5d2744-dd88-4955-91b9-d0301b4ce955 req-ec3c38a2-f7b1-486f-93a2-92b42889a0f9 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:32.653182 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-ad5d2744-dd88-4955-91b9-d0301b4ce955 req-ec3c38a2-f7b1-486f-93a2-92b42889a0f9 service nova] Creating event network-changed:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:08:32.658035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-ad5d2744-dd88-4955-91b9-d0301b4ce955 req-ec3c38a2-f7b1-486f-93a2-92b42889a0f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032323 Aug 22 11:08:32.662988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 293/588] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:33.108576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:33.109868 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:33.117160 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:33.117880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:33.118349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:33.119259 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:33.119730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:33.120158 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:33.186881 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:33.195186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:33.198155 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:33.198562 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4bd05924-0680-44df-9772-5b626fae58b1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1341 microversion: 2.20 time: 0.093961 Aug 22 11:08:33.199211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 296/589] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:33 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1341 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:34.222241 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:34.222948 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:34.229630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:34.230092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:34.231200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:34.231200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:34.231646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:34.232090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:34.300862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:34.309169 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:34.310671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:34.311774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ae7ce784-9fef-4055-a81b-b5920f64ea9d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1341 microversion: 2.20 time: 0.094312 Aug 22 11:08:34.312330 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 294/590] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:34 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1341 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:34.842901 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1886334143"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:34.848398 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:34.850323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:34.850821 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:34.851262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:34.852050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:34.852510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:34.852966 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:35.211153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.network.security_group_api [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Adding security group e7686041-37ac-4480-b8f5-01bae995ecad to port 604f8139-477b-4d71-a631-857498b648e7 Aug 22 11:08:35.333292 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:35.333896 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:35.340480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:35.340950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:35.341368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:35.342052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:35.342519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:35.342935 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:35.420592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:35.430443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:35.432982 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:35.433991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0f9a580d-226d-4dae-91cf-671f252a7de9 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1339 microversion: 2.20 time: 0.104635 Aug 22 11:08:35.434933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 295/591] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:35 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:08:35.516875 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1805247083", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "networks": [{"uuid": "b6389cfb-3b9b-462a-916a-81f9b683fb91"}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:35.571747 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] validate_networks() for [('b6389cfb-3b9b-462a-916a-81f9b683fb91', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:08:35.944340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2eae37ba-31ee-4edf-9f9e-6f46cb0a6f58 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/action" status: 202 len: 0 microversion: 2.1 time: 1.106002 Aug 22 11:08:35.946537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:08:35.946968 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:08:35.948098 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:08:35.948557 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:08:35.949206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:08:35.951918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 297/592] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:08:34 2022] POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:08:35.957470 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-a2edf866-b7ae-47a6-9813-a2a2a78e9833 req-5414d2b7-72f1-465f-9c44-1300c8526c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:35.959819 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:35.960315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:35.960853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:35.961587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:35.962046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:35.962502 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:35.973130 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a2edf866-b7ae-47a6-9813-a2a2a78e9833 req-5414d2b7-72f1-465f-9c44-1300c8526c48 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:35.974161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a2edf866-b7ae-47a6-9813-a2a2a78e9833 req-5414d2b7-72f1-465f-9c44-1300c8526c48 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:35.975274 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a2edf866-b7ae-47a6-9813-a2a2a78e9833 req-5414d2b7-72f1-465f-9c44-1300c8526c48 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:35.986613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Getting quotas for project 2fa4a05673a14d1195ca2066b57a6cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:08:35.991867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Getting quotas for user 270a3d73e04941a4b410b3e22043db9b and project 2fa4a05673a14d1195ca2066b57a6cb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:08:36.005061 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:08:36.007813 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:08:36.013963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-a2edf866-b7ae-47a6-9813-a2a2a78e9833 req-5414d2b7-72f1-465f-9c44-1300c8526c48 service nova] Creating event network-changed:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:08:36.022667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-a2edf866-b7ae-47a6-9813-a2a2a78e9833 req-5414d2b7-72f1-465f-9c44-1300c8526c48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069021 Aug 22 11:08:36.024156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 298/593] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:36.031468 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:36.032193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:36.055891 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:36.056487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:36.059236 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:36.060682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:36.061166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:36.062795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:36.153047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cdb2e88f-66e9-42b3-b9f9-d54f3621c6c8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636578 Aug 22 11:08:36.154688 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 296/594] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:08:36.169578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9b1bc5ee-a46b-48b3-b4bd-c81c53d38e11 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:36.170199 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9b1bc5ee-a46b-48b3-b4bd-c81c53d38e11 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:36.278078 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9b1bc5ee-a46b-48b3-b4bd-c81c53d38e11 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:36.287007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9b1bc5ee-a46b-48b3-b4bd-c81c53d38e11 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1219 microversion: 2.1 time: 0.124563 Aug 22 11:08:36.288278 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 297/595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:36 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:36.456941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:36.457751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:36.465413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:36.466183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:36.466848 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:36.467735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:36.468365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:36.468974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:36.525733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:36.540048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b64ab13-d762-49e1-9e1e-2aee1be7a020 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1760 microversion: 2.1 time: 0.514123 Aug 22 11:08:36.542408 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 299/596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:36 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1760 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:36.640681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:36.649266 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:36.651913 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:36.653358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-539de62e-cc17-4000-891c-ad00d388c165 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.201237 Aug 22 11:08:36.654170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 298/597] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:36 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:37.309482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:37.309985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:37.316289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:37.316767 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:37.317196 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:37.317875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:37.318343 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:37.318759 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:37.380807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:37.394739 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-283b4cf5-58bd-43f9-b99b-79e7dad9b73c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1223 microversion: 2.1 time: 0.089566 Aug 22 11:08:37.395518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 300/598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:37 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:37.677176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:37.677773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:37.684837 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:37.685514 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:37.686013 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:37.687115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:37.687567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:37.687981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:37.834299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:37.843749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:37.845303 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:37.846358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7af149e7-457f-4ccf-9245-127d61953e6d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.173302 Aug 22 11:08:37.846911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 299/599] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:37 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:38.043043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-cf460766-634c-46c8-a14a-70e5040f292a req-07df215e-ad01-4173-80fe-e06e42c475a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:38.054027 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-cf460766-634c-46c8-a14a-70e5040f292a req-07df215e-ad01-4173-80fe-e06e42c475a0 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:38.054587 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-cf460766-634c-46c8-a14a-70e5040f292a req-07df215e-ad01-4173-80fe-e06e42c475a0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:38.055149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-cf460766-634c-46c8-a14a-70e5040f292a req-07df215e-ad01-4173-80fe-e06e42c475a0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:38.069290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-cf460766-634c-46c8-a14a-70e5040f292a req-07df215e-ad01-4173-80fe-e06e42c475a0 service nova] Creating event network-changed:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:08:38.075439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-cf460766-634c-46c8-a14a-70e5040f292a req-07df215e-ad01-4173-80fe-e06e42c475a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035764 Aug 22 11:08:38.076243 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 301/600] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:38.416713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:38.417246 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:38.423105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:38.423612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:38.424044 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:38.424725 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:38.425174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:38.425595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:38.486155 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:38.493644 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ca91b421-ef91-47e9-bc40-35fece75da22 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1279 microversion: 2.1 time: 0.080818 Aug 22 11:08:38.494251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 300/601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:38 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:38.869566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:38.870276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:38.876983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:38.877469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:38.877899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:38.878629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:38.879080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:38.879499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:39.284106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:39.295755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:39.297589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:39.300330 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2f8c82a7-3d4b-45c6-8d86-b2fb82e7d630 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.435059 Aug 22 11:08:39.313009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 302/602] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:38 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:39.517236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:39.519080 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:39.526499 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:39.527027 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:39.527459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:39.528255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:39.528700 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:39.529170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:39.604660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:39.613187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6eba05bc-b9ca-4907-8800-83167b751717 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1289 microversion: 2.1 time: 0.102246 Aug 22 11:08:39.613776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 301/603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:39 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:40.341091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:40.341710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:40.343770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:40.344563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:40.350522 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:40.351008 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:40.351472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:40.352344 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:40.352939 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:40.353538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:40.549018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:40.568956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:40.576909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:40.578275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e6e145a-523c-4b5d-b7ce-bf1a264c775e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.247822 Aug 22 11:08:40.580492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 303/604] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:40 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:40.641397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:40.642747 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:40.656454 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:40.656960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:40.657417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:40.658179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:40.658879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:40.659072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:40.815701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:40.827215 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0bf59515-3b51-48a6-874a-ebbfca0c57e2 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.187374 Aug 22 11:08:40.827215 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 302/605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:40 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:41.220250 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-02e9dd86-f37a-4967-b34b-a0c3101168c4 req-3b6d4ae7-b1ae-4875-aa34-fe05e386c8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846a59f1-3bb6-48cc-bf8f-31862239917d", "tag": "4abc0f6a-0691-4016-8def-aff1874f8eae"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:41.230991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-02e9dd86-f37a-4967-b34b-a0c3101168c4 req-3b6d4ae7-b1ae-4875-aa34-fe05e386c8c9 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:41.240516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-02e9dd86-f37a-4967-b34b-a0c3101168c4 req-3b6d4ae7-b1ae-4875-aa34-fe05e386c8c9 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:41.240516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-02e9dd86-f37a-4967-b34b-a0c3101168c4 req-3b6d4ae7-b1ae-4875-aa34-fe05e386c8c9 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:41.243436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-02e9dd86-f37a-4967-b34b-a0c3101168c4 req-3b6d4ae7-b1ae-4875-aa34-fe05e386c8c9 service nova] Creating event network-changed:4abc0f6a-0691-4016-8def-aff1874f8eae for instance 846a59f1-3bb6-48cc-bf8f-31862239917d on hv-cinder-85394 Aug 22 11:08:41.249069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-02e9dd86-f37a-4967-b34b-a0c3101168c4 req-3b6d4ae7-b1ae-4875-aa34-fe05e386c8c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032764 Aug 22 11:08:41.249666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 304/606] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:41.609205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:41.609808 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:41.615825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:41.616300 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:41.616733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:41.617419 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:41.617870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:41.618309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:41.753551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:41.762426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:41.763929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:41.765075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7897524a-3251-4714-a3be-8699a68af3e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.160402 Aug 22 11:08:41.765640 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 303/607] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:41 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:41.847332 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:41.848113 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:41.855389 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:41.855906 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:41.856342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:41.857042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:41.857493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:41.857911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:42.036403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:42.044859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aa3b6dd7-d275-4a04-b749-c2b6ec9644b8 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.201755 Aug 22 11:08:42.045427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 305/608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:41 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:42.591793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-732328b0-7345-45d2-8c3f-50a7de4ea436 req-209448f3-a495-4813-b2af-069ba3736d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "name": "network-vif-plugged", "status": "completed", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:42.601024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-732328b0-7345-45d2-8c3f-50a7de4ea436 req-209448f3-a495-4813-b2af-069ba3736d6f service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:42.601493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-732328b0-7345-45d2-8c3f-50a7de4ea436 req-209448f3-a495-4813-b2af-069ba3736d6f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:42.601919 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-732328b0-7345-45d2-8c3f-50a7de4ea436 req-209448f3-a495-4813-b2af-069ba3736d6f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:42.613491 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-732328b0-7345-45d2-8c3f-50a7de4ea436 req-209448f3-a495-4813-b2af-069ba3736d6f service nova] Creating event network-vif-plugged:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:08:42.618223 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-732328b0-7345-45d2-8c3f-50a7de4ea436 req-209448f3-a495-4813-b2af-069ba3736d6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031421 Aug 22 11:08:42.618818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 304/609] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:42.788670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:42.789278 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:42.796185 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:42.796658 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:42.797113 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:42.797791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:42.798259 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:42.798673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:42.929676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:42.937980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:42.939534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:42.940642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b152d228-acd3-4847-97a5-6f8b01435a9e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.155841 Aug 22 11:08:42.941192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 306/610] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:42 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:43.067784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:43.068472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:43.075206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:43.075727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:43.076180 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:43.076853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:43.077296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:43.077712 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:43.212608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:43.220327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1ae8fd17-3e45-4938-a662-1d7faacf622d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.157875 Aug 22 11:08:43.220883 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 305/611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:43 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:43.963457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:43.964084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:43.966997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:43.971695 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:43.972224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:43.972673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:43.973380 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:43.973834 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:43.974290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:44.113779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:44.122477 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:44.124068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:44.125362 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f33aae2c-b22b-4ba9-bb9e-d55fdea390db tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.165762 Aug 22 11:08:44.125987 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 307/612] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:43 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:44.241225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:44.241836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:44.248353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:44.248836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:44.249273 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:44.249992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:44.250492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:44.250920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:44.380731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:44.388406 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d032e4cd-18a3-4083-be02-adf198579e56 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.151013 Aug 22 11:08:44.388973 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 306/613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:44 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:45.147438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:45.148047 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:45.155253 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:45.155735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:45.156167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:45.156852 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:45.157301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:45.157719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:45.298979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:45.307075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:45.308559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:45.309699 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-956d269b-f2d6-428e-9ed3-1d0b66271c48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1406 microversion: 2.20 time: 0.166247 Aug 22 11:08:45.310269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 308/614] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:45 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:45.409578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:45.410186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:45.416668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:45.417170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:45.417585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:45.418290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:45.418746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:45.419736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:45.553938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:45.562002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e4dfdded-5d41-43c3-a0cf-836ce7033804 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.156205 Aug 22 11:08:45.562588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 307/615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:45 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:46.332105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:46.332641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:46.338983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.339475 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.339884 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.340565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.341669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.342133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.473163 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:46.475441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:46.482110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:46.483907 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:46.485068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9d3dfedb-9397-494e-adf6-c692aeb92f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1598 microversion: 2.20 time: 0.156917 Aug 22 11:08:46.485601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 309/616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:08:46 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:08:46.508746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:46.509305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:46.511324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:46.512505 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=14 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:46.520559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.521306 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.522875 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.523068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.523769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.524424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.582427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:46.583079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:46.593184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.593675 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.594397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.594821 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.595284 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.595749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.615221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-22aa7caf-4c96-4df8-a99b-a2982805b98d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111032 Aug 22 11:08:46.615707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 308/617] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 22 11:08:46 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:08:46.621977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-7b356ef7-b2f5-4d05-85b4-4ba152d7d43f req-e788fe51-eb97-4419-b663-d24dd29e0b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846a59f1-3bb6-48cc-bf8f-31862239917d", "name": "network-vif-plugged", "status": "completed", "tag": "4abc0f6a-0691-4016-8def-aff1874f8eae"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:46.631670 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7b356ef7-b2f5-4d05-85b4-4ba152d7d43f req-e788fe51-eb97-4419-b663-d24dd29e0b0d service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:46.632358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7b356ef7-b2f5-4d05-85b4-4ba152d7d43f req-e788fe51-eb97-4419-b663-d24dd29e0b0d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:46.632933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7b356ef7-b2f5-4d05-85b4-4ba152d7d43f req-e788fe51-eb97-4419-b663-d24dd29e0b0d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:46.649584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-7b356ef7-b2f5-4d05-85b4-4ba152d7d43f req-e788fe51-eb97-4419-b663-d24dd29e0b0d service nova] Creating event network-vif-plugged:4abc0f6a-0691-4016-8def-aff1874f8eae for instance 846a59f1-3bb6-48cc-bf8f-31862239917d on hv-cinder-85394 Aug 22 11:08:46.654756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-7b356ef7-b2f5-4d05-85b4-4ba152d7d43f req-e788fe51-eb97-4419-b663-d24dd29e0b0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035282 Aug 22 11:08:46.658142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 309/618] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:08:46.750278 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:46.759939 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b58fd639-ccf7-4414-bca3-91c35d821e60 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.181302 Aug 22 11:08:46.774042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 310/619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:46 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:47.615219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-da8c5904-4ef3-454f-a18d-d553c7335558 req-53124bf6-e9a1-46c4-b77f-79f66afce5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:47.625326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-da8c5904-4ef3-454f-a18d-d553c7335558 req-53124bf6-e9a1-46c4-b77f-79f66afce5e8 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:47.625879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-da8c5904-4ef3-454f-a18d-d553c7335558 req-53124bf6-e9a1-46c4-b77f-79f66afce5e8 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:47.626426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-da8c5904-4ef3-454f-a18d-d553c7335558 req-53124bf6-e9a1-46c4-b77f-79f66afce5e8 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:47.637026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-da8c5904-4ef3-454f-a18d-d553c7335558 req-53124bf6-e9a1-46c4-b77f-79f66afce5e8 service nova] Creating event network-changed:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:08:47.641888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-da8c5904-4ef3-454f-a18d-d553c7335558 req-53124bf6-e9a1-46c4-b77f-79f66afce5e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030493 Aug 22 11:08:47.642495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 310/620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:47.781611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:47.782133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:47.788255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:47.788734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:47.789173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:47.789879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:47.790354 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:47.790774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:47.980108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:47.989395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fcc1e5a1-f862-42ae-9b78-b5c57ca9b58c tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1319 microversion: 2.1 time: 0.212234 Aug 22 11:08:47.990940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 311/621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:47 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:49.016871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:49.017467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:49.023545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:49.025591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:49.025591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:49.025591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:49.025591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:49.026033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:49.163218 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:49.171058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-93e43f4d-5ef0-4087-a934-ec8a94b40e4a tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1507 microversion: 2.1 time: 0.159998 Aug 22 11:08:49.171620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 311/622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:49 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:49.196182 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52308c66-ab57-46c6-8471-bcdf1905ba82", "device": "/dev/sdb"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:49.198530 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:49.205475 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:49.205954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:49.206502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:49.207200 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:49.207648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:49.208067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:49.849227 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b6c646fb-d531-4a8d-9c29-66e42bc801dd tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "POST /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656235 Aug 22 11:08:49.849754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 312/623] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:08:49 2022] POST /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:52.202605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:52.203115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:52.209501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:52.209981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:52.210459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:52.211146 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:52.211598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:52.212018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:52.225495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:52.234426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lazy-loading 'flavor' on Instance uuid aaba33f3-aef7-422c-a8f9-0e117100b0f3 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:08:52.459567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fed313d1-9550-4908-bc21-f260b74f714b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "POST /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3/action" status: 202 len: 0 microversion: 2.1 time: 0.261365 Aug 22 11:08:52.460206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 312/624] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:08:52 2022] POST /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:08:52.469705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:52.470787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:52.477385 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:52.477796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:52.478245 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:52.478929 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:52.479372 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:52.479789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:52.617331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:52.625773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f0dc2429-8822-44b9-ada8-43a524553200 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.160901 Aug 22 11:08:52.626367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 313/625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:52 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:52.839857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:52.840426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:52.847010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:52.847487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:52.847916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:52.848595 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:52.849043 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:52.849464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:52.932224 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lazy-loading 'services' on Instance uuid 790ba6d2-ada3-468b-bb51-1fca7bc7c349 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:08:53.140769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bd24e2da-abce-4c2b-a0f4-f1e32e405d67 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments/96914217-f278-4af0-9508-265b621791f4" status: 202 len: 0 microversion: 2.1 time: 0.304904 Aug 22 11:08:53.141469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 313/626] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:08:52 2022] DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments/96914217-f278-4af0-9508-265b621791f4 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:08:53.151434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:53.158520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:53.160644 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:53.161119 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:53.161550 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:53.162313 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:53.162763 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:53.163177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:53.192594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c3be2186-5967-4746-992d-bbc09765b5c6 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Aug 22 11:08:53.193145 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 314/627] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:53 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:53.648615 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:53.649261 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:53.655889 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:53.656376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:53.656807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:53.657542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:53.657995 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:53.658509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:53.791854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:53.799543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ccf6ae41-5e7c-4fd4-b0d2-ad14a1663307 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.155905 Aug 22 11:08:53.800100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 314/628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:53 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:54.205127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:54.207641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:54.214382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:54.214861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:54.215292 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:54.216013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:54.216461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:54.216883 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:54.248360 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-84432d4b-16d4-4f97-9958-2627e79ae8bb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Aug 22 11:08:54.248939 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 315/629] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:54 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:54.820683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:54.821319 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:54.823703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:08:54.828457 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:54.828940 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:54.829370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:54.830055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:54.830540 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:54.843517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:54.960396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:54.967963 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cc0e23dc-444d-4bb4-82f2-b56df15e1d51 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.151184 Aug 22 11:08:54.968509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 315/630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:54 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:55.259660 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:55.261776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:55.268318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:55.268801 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:55.269232 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:55.269914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:55.270391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:55.270810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:55.301586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ac7972fb-8f19-4ae7-bf67-8fe1c79bab66 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045859 Aug 22 11:08:55.302123 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 316/631] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:55 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:55.988957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:55.989557 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:55.996104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:55.998989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:55.998989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:55.998989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:55.998989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:55.999360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:56.135701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:56.143446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e6025c07-8d11-4db8-b38f-d1882df2a94b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.158321 Aug 22 11:08:56.144010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 316/632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:55 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:56.314643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:56.316768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:56.323072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:56.323554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:56.323995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:56.324687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:56.325144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:56.326117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:56.356227 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f9d5817a-6a5f-4b24-92b9-82f4ad7ca5d4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Aug 22 11:08:56.356787 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 317/633] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:56 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:57.164404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:57.164950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:57.171425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:57.171896 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:57.172324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:57.173037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:57.173490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:57.173898 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:57.317390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:57.325172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f33f3051-76b8-48ab-ba81-60a71de24ab0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.164695 Aug 22 11:08:57.325905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 317/634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:57 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:57.368258 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:57.370411 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:57.376729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:57.378745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:57.378745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:57.378745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:57.379232 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:57.379685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:57.409285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c028628-aba2-4b67-a46a-6a8d1b24aecf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Aug 22 11:08:57.409839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 318/635] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:57 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:58.346792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:58.347324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:58.353624 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:58.354103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:58.354598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:58.355292 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:58.355738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:58.356158 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:58.421656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:58.423886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:58.430321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:58.430804 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:58.431232 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:58.432365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:58.432365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:58.432780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:58.462396 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0ad19c05-e635-433a-bd03-f897a0834dcc tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Aug 22 11:08:58.462961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 319/636] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:58 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:08:58.490673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:58.498853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f06a26ed-0c53-46f9-ad27-3a87355c791d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.156017 Aug 22 11:08:58.499422 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 318/637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:58 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:08:59.130219 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:08:59.132421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:59.139026 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.139502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.139932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.140606 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.141051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.141468 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.327452 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c33997fe-facd-4e2d-a3cc-8a9c915ed842 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/action" status: 202 len: 0 microversion: 2.1 time: 0.200936 Aug 22 11:08:59.328321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 320/638] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:08:59 2022] POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:08:59.336368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:59.337050 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:59.343331 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.348443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.348443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.348443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.348443 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.349236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.476459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:59.478694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:59.485944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.486481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.486911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.487631 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.488074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.488495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.493600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:59.502803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-900d26c5-d878-42c4-8782-ef19961f2508 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1752 microversion: 2.1 time: 0.170361 Aug 22 11:08:59.503862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 319/639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:59 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:08:59.519664 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:08:59.519891 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1aef62f9-b1f4-40da-ba73-41a3af4bf0bf tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Aug 22 11:08:59.520275 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:08:59.520414 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 321/640] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:08:59 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:08:59.526087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.526621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.527059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.527753 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:08:59.528207 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:08:59.528688 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:08:59.664185 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:08:59.672014 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2258ce80-5725-41b4-9b5c-8dc89e0de324 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.156199 Aug 22 11:08:59.672603 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 320/641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:08:59 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:00.526046 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:00.526755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:00.532090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:00.534340 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:00.534666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:00.535143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:00.535583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:00.536289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:00.536745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:00.537172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:00.540033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:00.540484 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:00.540911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:00.541584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:00.542025 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:00.542464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:00.571253 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-446fb6b1-ec86-461e-8f79-fd365631a938 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Aug 22 11:09:00.571806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 321/642] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:09:00 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:09:00.679237 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:00.688161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c463a776-6aeb-47e4-921b-d3568c592e35 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1752 microversion: 2.1 time: 0.167130 Aug 22 11:09:00.688733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 322/643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:00 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:00.692918 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:00.693526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:00.699858 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:00.701169 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:00.701608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:00.702310 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:00.702763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:00.703182 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:00.838469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:00.847087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ff23bd71-55eb-4d98-b6e1-2f17841195e7 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.157946 Aug 22 11:09:00.863121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 322/644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:00 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:01.583907 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:01.586075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:01.592585 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:01.593065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:01.593499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:01.594349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:01.594827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:01.595258 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:01.630040 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d0bd15d8-1e5f-4f4d-bd5c-75aac82d4769 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050342 Aug 22 11:09:01.630665 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 323/645] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:09:01 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:01.709541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:01.710186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:01.716542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:01.717069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:01.717503 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:01.718189 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:01.718708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:01.721062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:01.869589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:01.870373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:01.877301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:01.881944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:01.881944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:01.881944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:01.881944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:01.882371 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:01.884935 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:01.892849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:01.896715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1d4ed6a0-c484-4b15-938b-40bdc8f8127c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1752 microversion: 2.1 time: 0.190864 Aug 22 11:09:01.897673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 323/646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:01 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:02.026217 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:02.034612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ece72425-82ba-458b-bd40-001fad0332a9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.169173 Aug 22 11:09:02.035176 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 324/647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:01 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:02.643203 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:02.645403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:02.651384 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:02.651867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:02.652308 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:02.652990 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:02.653480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:02.654090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:02.682007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-04178e43-a7e9-4290-b4e4-4f8616484be0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042924 Aug 22 11:09:02.682581 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 324/648] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:09:02 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:09:02.760992 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:02.761508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:02.769226 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:02.769700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:02.770132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:02.770839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:02.771289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:02.771705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:02.797011 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:09:02.918911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:02.919501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:02.925735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:02.926271 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:02.926722 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:02.927501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:02.927951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:02.928368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:03.055842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d6f735f7-1e2f-447b-92dc-009d7a583bd0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 204 len: 0 microversion: 2.1 time: 0.298365 Aug 22 11:09:03.056435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 325/649] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:09:02 2022] DELETE /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:09:03.065473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:03.066161 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:03.072042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:03.072524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:03.072951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:03.073676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:03.074195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:03.074648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:03.077303 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:03.085334 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-491bad5c-c5f1-4c41-9bb8-b459ab14e103 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.170260 Aug 22 11:09:03.085892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 325/650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:02 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:03.090217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:03.090873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:03.096529 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:03.097009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:03.097436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:03.098115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:03.098583 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:03.098998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:03.114450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:03.213292 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:03.221830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d093df80-2fb9-4661-b02d-1cae3e10cf3e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.160619 Aug 22 11:09:03.223424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 326/651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:03 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:03.233204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:03.241353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4e0b0599-9909-4288-a08b-bf30196cf55c tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.154370 Aug 22 11:09:03.241884 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 326/652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:03 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:04.107962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:04.108662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:04.115331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:04.115752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:04.116179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:04.116854 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:04.117296 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:04.117710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:04.243109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:04.243760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:04.250733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:04.251215 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:04.251643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:04.252335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:04.252789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:04.253284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:04.255778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:04.264547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7b35931c-40de-4b67-8eb0-765785f96728 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.160991 Aug 22 11:09:04.265113 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 327/653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:04 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:04.269860 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:04.270666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:04.276615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:04.277262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:04.277700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:04.278412 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:04.279058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:04.279487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:04.400831 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:04.409250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-03a97e58-7dee-4561-bc76-8032a6d5fd42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.169918 Aug 22 11:09:04.409978 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 327/654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:04 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:04.412412 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:04.420111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-84c1a63a-6cf7-4a02-b502-41d6cedd63d5 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.154041 Aug 22 11:09:04.420667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 328/655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:04 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:05.288185 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:05.288798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:05.295474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:05.295977 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:05.296432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:05.297297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:05.297579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:05.297986 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:05.430693 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:05.431355 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:05.438456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:05.439844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:05.440441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:05.441349 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:05.441836 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:05.442648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:05.444873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:05.454631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3c547fbb-e1d0-4455-b75b-a67f379c78ef tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.170164 Aug 22 11:09:05.455446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 328/656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:05 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:05.460276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:05.460878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:05.468943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:05.470687 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:05.470687 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:05.470908 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:05.471257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:05.471684 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:05.580212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:05.588004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ec5c182a-d28e-4c03-9e88-4a0b90014d56 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.161363 Aug 22 11:09:05.588663 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 329/657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:05 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:05.604826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:05.613016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-13ef72db-c971-4547-81a3-8827ee319535 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.156322 Aug 22 11:09:05.613573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 329/658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:05 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:06.477071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:06.477745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:06.485108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:06.485596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:06.488309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:06.488309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:06.488309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:06.488309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:06.609076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:06.609952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:06.616589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:06.617068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:06.617497 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:06.618182 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:06.618712 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:06.619127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:06.635230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:06.644247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3c635ee0-db86-452d-9dda-5c336ebdfcfb tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.171329 Aug 22 11:09:06.644808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 330/659] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:06 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:06.649666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:06.650268 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:06.666256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:06.666761 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:06.667205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:06.667923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:06.668386 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:06.668810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:06.761717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:06.769897 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d730236e-ad10-4289-b2d0-9cc33a9acef3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.164756 Aug 22 11:09:06.770501 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 330/660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:06 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:06.799752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:06.807603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8bc72612-928f-4b91-aced-90789f47e063 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.161837 Aug 22 11:09:06.808166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 331/661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:06 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:07.664680 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:07.665287 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:07.672735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:07.673210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:07.674450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:07.674450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:07.674853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:07.675272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:07.790770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:07.791399 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:07.798442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:07.799373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:07.799373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:07.800040 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:07.800484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:07.800903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:07.822954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:07.831432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-166305b9-0143-4641-a724-5e7e14015db0 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.170490 Aug 22 11:09:07.832094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 331/662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:07 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:07.842524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:07.842524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:07.843924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:07.844632 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:07.845276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:07.847734 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:07.848231 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:07.848682 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:07.953603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:07.961875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-65841263-15d2-44d7-9054-ceab1027c857 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.174804 Aug 22 11:09:07.962576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 332/663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:07 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:07.993549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:08.001775 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8fc1deb0-d0b9-4698-9948-f7f4ab0de98a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.168617 Aug 22 11:09:08.002307 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 332/664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:07 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:08.854103 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:08.854815 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:08.862444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:08.862933 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:08.863364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:08.864083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:08.864692 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:08.865106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:08.984462 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:08.985441 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:08.992343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:08.998211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:08.998211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:08.998211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:08.998211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:08.998859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:09.007277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:09.015742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ef3fc014-ad6e-421c-93e2-4fd4ac747b95 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.165451 Aug 22 11:09:09.016306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 333/665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:08 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:09.026343 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:09.026343 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:09.030348 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:09.030627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:09.031065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:09.031758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:09.032208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:09.032629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:09.128949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:09.136844 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5010905b-5a79-416a-b7bf-1d6e5015001d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.157071 Aug 22 11:09:09.137477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 333/666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:08 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:09.164003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:09.172315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3cd58361-e386-479c-b8a9-d02dfac38d2a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.152950 Aug 22 11:09:09.172917 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 334/667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:09 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:09.866549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:09.867045 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:09.873950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:09.874578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:09.875011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:09.875717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:09.876169 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:09.876591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:09.959671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lazy-loading 'services' on Instance uuid 846a59f1-3bb6-48cc-bf8f-31862239917d {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:10.037936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:10.038571 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:10.045773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:10.046260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:10.046822 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:10.047542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:10.047994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:10.048417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:10.169902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cd5f91f4-692e-434a-a10a-1bbd0f0b2777 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "DELETE /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d/os-volume_attachments/52308c66-ab57-46c6-8471-bcdf1905ba82" status: 202 len: 0 microversion: 2.1 time: 0.306475 Aug 22 11:09:10.170781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 334/668] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:09:09 2022] DELETE /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d/os-volume_attachments/52308c66-ab57-46c6-8471-bcdf1905ba82 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:10.176067 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:10.176757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:10.183391 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:10.186068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:10.186068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:10.186068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:10.189248 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:10.189908 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:10.331711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:10.340564 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bd46ff5b-777f-49c2-855e-48e9a3438e75 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.168631 Aug 22 11:09:10.341969 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 335/669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:10 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:10.347460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:10.348245 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:10.354488 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:10.355692 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:10.356305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:10.357720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:10.358179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:10.358625 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:10.409586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:10.418426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c5376c1-edc3-4158-a1ae-516ca2d6cf74 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.384370 Aug 22 11:09:10.419006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 335/670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:10 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:10.493397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:10.501632 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8e7c2a0c-b870-4288-ab44-e72b7c7d8744 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1690 microversion: 2.1 time: 0.158411 Aug 22 11:09:10.502201 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 336/671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:10 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:11.017764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-78aef722-6f58-4702-ad63-038160e3837e req-3592e034-7002-4d82-9b5b-0c8fe8cad925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790ba6d2-ada3-468b-bb51-1fca7bc7c349", "name": "network-vif-deleted", "tag": "ae8855e3-0bba-4105-b7f6-23b967086d90"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:11.027781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-78aef722-6f58-4702-ad63-038160e3837e req-3592e034-7002-4d82-9b5b-0c8fe8cad925 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.030269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-78aef722-6f58-4702-ad63-038160e3837e req-3592e034-7002-4d82-9b5b-0c8fe8cad925 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.030269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-78aef722-6f58-4702-ad63-038160e3837e req-3592e034-7002-4d82-9b5b-0c8fe8cad925 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.042103 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-78aef722-6f58-4702-ad63-038160e3837e req-3592e034-7002-4d82-9b5b-0c8fe8cad925 service nova] Creating event network-vif-deleted:ae8855e3-0bba-4105-b7f6-23b967086d90 for instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 on hv-cinder-85394 Aug 22 11:09:11.047297 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-78aef722-6f58-4702-ad63-038160e3837e req-3592e034-7002-4d82-9b5b-0c8fe8cad925 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Aug 22 11:09:11.048426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 336/672] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:11.363302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:11.363909 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:11.370289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.370775 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.371206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.371891 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.373055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.373584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.443691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:11.444489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:11.450691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.451410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.451923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.452876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.453280 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.453780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.512661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:11.523521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4a0bbdb1-b9ab-4eb4-b89d-5b4fe97cb180 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.163850 Aug 22 11:09:11.524606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 337/673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:11 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:11.530545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:11.531157 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:11.537449 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.538131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.538771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.539650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:11.540270 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:11.540870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:11.611554 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:11.619648 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2bcb1620-551d-4cbb-a494-a86ad2520856 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1624 microversion: 2.1 time: 0.093438 Aug 22 11:09:11.621265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 338/674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:11 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1624 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:11.639316 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:11.648682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8ef4c274-11cb-4a59-9d2f-98d6a51f49b2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.209181 Aug 22 11:09:11.649277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 337/675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:11 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:12.545806 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:12.546643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:12.555644 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.556309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.556752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.557538 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.558058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.558580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.646145 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:12.646797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:12.653674 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.654195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.660752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.661474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.661932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.662428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.696171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.696648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.697138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.697588 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lazy-loading 'fault' on Instance uuid 790ba6d2-ada3-468b-bb51-1fca7bc7c349 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:12.709616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:12.717851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e67b53de-db31-473d-bfca-729cf21dbe42 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.176124 Aug 22 11:09:12.718515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 339/676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:12 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:12.723062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:12.723652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:12.729613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.730062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.730591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.731277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:12.731814 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:12.732236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:12.755648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:12.764371 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b08ed195-0957-443a-81c1-f61142d4f933 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 200 len: 1336 microversion: 2.1 time: 0.123642 Aug 22 11:09:12.765128 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 338/677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:12 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:12.885372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:12.896205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6d8978c6-2fb7-4626-ab3b-67a66c152993 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.176712 Aug 22 11:09:12.896773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 340/678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:12 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:13.419525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:13.420606 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:13.426785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:13.427261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:13.431839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:13.431839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:13.431839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:13.431839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:13.444008 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:13.454554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:09:13.743213 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:13.743823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:13.747547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6a2e084f-24f1-474e-ada9-3e0a55690ec1 tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "DELETE /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 204 len: 0 microversion: 2.1 time: 0.331568 Aug 22 11:09:13.748190 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 339/679] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:09:13 2022] DELETE /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:09:13.750507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:13.751117 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:13.755468 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:13.755468 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:13.755468 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:13.755468 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:13.757358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:13.758051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:13.767611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:13.768326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:13.768935 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:13.769784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:13.770519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:13.771089 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.020507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:14.026818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:14.029866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-59d87bdd-8b42-4437-92af-1f21882acee8 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1569 microversion: 2.1 time: 0.288981 Aug 22 11:09:14.029866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 341/680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:13 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:14.034009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:14.034756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 790ba6d2-ada3-468b-bb51-1fca7bc7c349] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:14.035372 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3ec0effc-26bf-4fa8-bd0c-f1f64f6d288d tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1513 microversion: 2.1 time: 0.282578 Aug 22 11:09:14.036079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 340/681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:13 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:14.040322 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:14.040917 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:14.047437 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.047997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.048397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.049088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.049539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.049958 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.052821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.053307 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.053743 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.054519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.054974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.055398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.069442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] HTTP exception thrown: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 could not be found. Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Request method failure captured: Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 HTTP/1.1 Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K4VPSfrEmSjxqKPp3GzLTG_GldlBtAqF8U7AEJ02UvMsGRiwjuhYgyZ7Mg3TCdeKVJE7oBebf3PBSTNyGQ3GyCvQznzFNRUA7OCBrgPh7oMsQ07BCVXzTNERgNF7JvChaLCeRTClI1YoV3HBTE0FXwpqtnGFn1THAE1P8dmPV3lkw Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:09:14.071262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2cb7651353884366b2ca72a7e272bdc0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 7c6fee0b956e41a7b2d9b914043633ea Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 could not be found. Aug 22 11:09:14.075579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '790ba6d2-ada3-468b-bb51-1fca7bc7c349'} Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 could not be found. Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:09:14.077240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 could not be found. Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 could not be found. Aug 22 11:09:14.079567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:14.082019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Returning 404 to user: Instance 790ba6d2-ada3-468b-bb51-1fca7bc7c349 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:09:14.082019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e4938d13-3602-46b2-a050-fcceb7f0d668 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349" status: 404 len: 111 microversion: 2.1 time: 0.042259 Aug 22 11:09:14.082019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 342/682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:14 2022] GET /compute/v2.1/servers/790ba6d2-ada3-468b-bb51-1fca7bc7c349 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:09:14.082019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:14.082019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:14.085410 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.085896 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.086363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.087064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.087510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.087929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.091803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:14.132989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121143) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 11:09:14.206842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:14.215036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3f049719-abd8-4b6c-89d5-f1ff25e99d94 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.178147 Aug 22 11:09:14.215604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 341/683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:14 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:14.220203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-22413ce6-b74b-4b32-9c14-b7e17a507897 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '.version_select at 0x7f3b4c7dc550>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:14.231539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:14.325556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-22413ce6-b74b-4b32-9c14-b7e17a507897 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057763902" status: 202 len: 0 microversion: 2.1 time: 0.108838 Aug 22 11:09:14.326283 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 342/684] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 22 11:09:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057763902 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:14.411676 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8126a202-4af2-4795-9d49-b278efde941f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "POST /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3/action" status: 202 len: 0 microversion: 2.1 time: 0.337507 Aug 22 11:09:14.416655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 343/685] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:09:14 2022] POST /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:14.420822 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:14.421828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:14.427805 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.428216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.428646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.429360 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:14.429775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:14.430717 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:14.644542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:14.652762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff4b2275-bd18-40d8-948a-4b2d3b0ad1e3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1577 microversion: 2.1 time: 0.236373 Aug 22 11:09:14.653323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 343/686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:14 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:15.057490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:15.058070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:15.065072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:15.065557 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:15.065988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:15.066711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:15.067160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:15.067578 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:15.236432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:15.237135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:15.243873 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:15.244355 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:15.244786 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:15.245483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:15.245962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:15.246576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:15.402649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:15.410807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ab4f1503-a84b-4d01-ade8-e0e1bd551183 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.178610 Aug 22 11:09:15.411384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 344/687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:15 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:15.451031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:15.459049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-689c6f32-a7a4-470e-adb7-0e55ac39f9be tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1513 microversion: 2.1 time: 0.406032 Aug 22 11:09:15.459822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 344/688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:15 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1513 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:15.675561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:15.676172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:15.682202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:15.682720 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:15.683156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:15.683839 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:15.684290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:15.684712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:15.823532 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:15.832582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d5a65a12-be2c-454b-85ce-0c12661eb513 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1577 microversion: 2.1 time: 0.160656 Aug 22 11:09:15.833178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 345/689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:15 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:16.370325 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-73d98d2a-f689-462a-8cdd-a2c95de1d58d req-a4c328ca-5fc2-4b0d-8110-96907721c6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846a59f1-3bb6-48cc-bf8f-31862239917d", "name": "network-vif-deleted", "tag": "4abc0f6a-0691-4016-8def-aff1874f8eae"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:16.381437 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-73d98d2a-f689-462a-8cdd-a2c95de1d58d req-a4c328ca-5fc2-4b0d-8110-96907721c6ed service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.381905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-73d98d2a-f689-462a-8cdd-a2c95de1d58d req-a4c328ca-5fc2-4b0d-8110-96907721c6ed service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.382426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-73d98d2a-f689-462a-8cdd-a2c95de1d58d req-a4c328ca-5fc2-4b0d-8110-96907721c6ed service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.394920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-73d98d2a-f689-462a-8cdd-a2c95de1d58d req-a4c328ca-5fc2-4b0d-8110-96907721c6ed service nova] Creating event network-vif-deleted:4abc0f6a-0691-4016-8def-aff1874f8eae for instance 846a59f1-3bb6-48cc-bf8f-31862239917d on hv-cinder-85394 Aug 22 11:09:16.399656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-73d98d2a-f689-462a-8cdd-a2c95de1d58d req-a4c328ca-5fc2-4b0d-8110-96907721c6ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033081 Aug 22 11:09:16.400233 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 345/690] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:16.431733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:16.432381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:16.439466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.439941 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.440377 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.441055 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.441509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.441978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.481774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:16.483475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:16.491108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.491876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.492401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.493151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.493658 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.494125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.568548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270a3d73e04941a4b410b3e22043db9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4a05673a14d1195ca2066b57a6cb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:16.577459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8e0c5045-6e6a-47b5-bc33-c79c765bb9bb tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 200 len: 1471 microversion: 2.1 time: 0.100042 Aug 22 11:09:16.578046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 346/691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:16 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 1471 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:16.613205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:16.621642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6b40f291-d5fd-4867-abce-e8715589078f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1757 microversion: 2.1 time: 0.193832 Aug 22 11:09:16.622218 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 346/692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:16 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:16.695809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-4d77aa98-a07c-41f1-8fe9-dde5135cbf31 req-4489ae52-9da7-4979-86e6-9aa41d5c421e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:16.708868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-4d77aa98-a07c-41f1-8fe9-dde5135cbf31 req-4489ae52-9da7-4979-86e6-9aa41d5c421e service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.708868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-4d77aa98-a07c-41f1-8fe9-dde5135cbf31 req-4489ae52-9da7-4979-86e6-9aa41d5c421e service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.708868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-4d77aa98-a07c-41f1-8fe9-dde5135cbf31 req-4489ae52-9da7-4979-86e6-9aa41d5c421e service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.720256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.compute.server_external_events [req-4d77aa98-a07c-41f1-8fe9-dde5135cbf31 req-4489ae52-9da7-4979-86e6-9aa41d5c421e service nova] Unable to find a host for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3. Dropping event network-vif-unplugged {{(pid=121143) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 11:09:16.721206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-4d77aa98-a07c-41f1-8fe9-dde5135cbf31 req-4489ae52-9da7-4979-86e6-9aa41d5c421e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030695 Aug 22 11:09:16.721989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 347/693] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 22 11:09:16.854125 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:16.855376 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:16.863364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.863870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.864306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:16.865053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:16.865501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:16.866045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.005030 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:17.012722 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8139b5b9-b630-4579-b9c0-4bc7cd65ae09 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1519 microversion: 2.1 time: 0.162608 Aug 22 11:09:17.013628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 347/694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:16 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:17.598710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:17.599862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] [instance: 846a59f1-3bb6-48cc-bf8f-31862239917d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:17.606128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.613895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.613895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.613895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.613895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.614336 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.622781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] HTTP exception thrown: Instance 846a59f1-3bb6-48cc-bf8f-31862239917d could not be found. Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Request method failure captured: Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d HTTP/1.1 Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2NVeZhkNdOx-YDiCUapWwBrBjHTRPM8bhrKIOGJ_3TP0DYuqPAG4vd1MHhqwmOzuBZkTBwDIXSvRDzS1EWUnn37SadVIxP9fzVl2itbAJIfXYQwHe_op6BF2JxvWL9grvvgZzGpQXosr7J06TgW-0r7TjHTbu3U7tUnK4Y9P6OFoVA Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 2fa4a05673a14d1195ca2066b57a6cb8 Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1980603323 Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:09:17.624773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2fa4a05673a14d1195ca2066b57a6cb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2fa4a05673a14d1195ca2066b57a6cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2fa4a05673a14d1195ca2066b57a6cb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2fa4a05673a14d1195ca2066b57a6cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-VolumesSnapshotTestJSON-1980603323 Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 2fa4a05673a14d1195ca2066b57a6cb8 Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1980603323 Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-VolumesSnapshotTestJSON-1980603323-project Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 270a3d73e04941a4b410b3e22043db9b Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-VolumesSnapshotTestJSON-1980603323-project Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 846a59f1-3bb6-48cc-bf8f-31862239917d could not be found. Aug 22 11:09:17.626299 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '846a59f1-3bb6-48cc-bf8f-31862239917d'} Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846a59f1-3bb6-48cc-bf8f-31862239917d could not be found. Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:09:17.627042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846a59f1-3bb6-48cc-bf8f-31862239917d could not be found. Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846a59f1-3bb6-48cc-bf8f-31862239917d could not be found. Aug 22 11:09:17.628390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:17.629794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] Returning 404 to user: Instance 846a59f1-3bb6-48cc-bf8f-31862239917d could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:09:17.629794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-01cf98ca-f154-4d51-8069-3798992bc41e tempest-VolumesSnapshotTestJSON-1980603323 tempest-VolumesSnapshotTestJSON-1980603323-project] 10.222.0.48 "GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d" status: 404 len: 111 microversion: 2.1 time: 0.031316 Aug 22 11:09:17.629794 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 348/695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:17 2022] GET /compute/v2.1/servers/846a59f1-3bb6-48cc-bf8f-31862239917d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:09:17.644059 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:17.644666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:17.651149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.651632 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.652063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.652908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.653271 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.653624 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.805920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:17.814215 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-36e8d89e-5d2b-44dc-b0f7-01373817ced4 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1760 microversion: 2.1 time: 0.174663 Aug 22 11:09:17.814798 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 348/696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:17 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:17.892417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:17.893153 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:17.899821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.900494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.900934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.901649 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.902112 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.902567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.929296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fcccf87a-e054-4095-9900-4ad4128a36d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/ips" status: 200 len: 150 microversion: 2.1 time: 0.041363 Aug 22 11:09:17.930404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 349/697] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:09:17 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:17.945766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:17.946291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:17.953462 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.953960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.954431 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.955393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:17.956053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:17.956484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:17.981855 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:09:18.033076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:18.033685 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:18.040394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:18.040897 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:18.041337 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:18.042039 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:18.042617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:18.043044 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:18.186819 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:18.194526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ef95595d-ff9f-400c-91e2-017a7bb2f436 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1519 microversion: 2.1 time: 0.165293 Aug 22 11:09:18.195089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 350/698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:18 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:18.308178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5cea6755-3d5c-431d-9e40-df349a4f7948 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 204 len: 0 microversion: 2.1 time: 0.365940 Aug 22 11:09:18.309851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 349/699] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:09:17 2022] DELETE /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:09:18.323492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:18.324095 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:18.330543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:18.331024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:18.331601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:18.332482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:18.332923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:18.333390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:18.467626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:18.475129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e41e8773-9259-4ad3-a7bc-b23b5fde85db tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1509 microversion: 2.1 time: 0.155555 Aug 22 11:09:18.475678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 351/700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:18 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:19.215902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:19.216596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:19.223075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:19.223553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:19.224019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:19.224704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:19.225157 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:19.225582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:19.361831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:19.369471 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86ded6d1-4446-4fa7-909a-ecfac161ce58 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.157811 Aug 22 11:09:19.370038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 350/701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:19 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:19.496647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:19.497164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:19.504118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:19.504593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:19.505021 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:19.505694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:19.506139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:19.506612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:19.614556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "685af9d7-742e-4eeb-a93e-3fb6cd0f504c"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:19.616789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:19.625567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:19.626072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:19.626536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:19.627429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:19.628071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:19.628936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:19.647060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:19.655163 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ee278f0b-f7f6-43b3-b957-53ae23abe159 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1509 microversion: 2.1 time: 0.162255 Aug 22 11:09:19.657531 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 352/702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:19 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:20.390503 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:20.391032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:20.396945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:20.397457 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:20.397894 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:20.398601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:20.399055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:20.399477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:20.532770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:20.540420 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-571e8195-8ac0-4ae7-8214-e07b7eb0d2fb tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.154029 Aug 22 11:09:20.540987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 353/703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:20 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:20.677430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:20.678059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:20.683901 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:20.689964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:20.689964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:20.689964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:20.689964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:20.690413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:20.818651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:20.826348 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0848016a-ac09-427e-8190-e23c8f6e8c39 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1509 microversion: 2.1 time: 0.152700 Aug 22 11:09:20.826912 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 354/704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:20 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:21.561601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:21.562925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:21.569193 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:21.569666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:21.570099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:21.570812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:21.571260 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:21.571679 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:21.704083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:21.711973 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-76318ba7-6c85-47d2-858d-62461f848a1e tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.154139 Aug 22 11:09:21.712446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 355/705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:21 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:21.848792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:21.849369 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:21.855413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:21.855895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:21.856328 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:21.857011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:21.857460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:21.857882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:21.989551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:21.997212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d3be8d19-1d80-42fa-bf6b-8d11c493fd4f tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1509 microversion: 2.1 time: 0.152474 Aug 22 11:09:21.997766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 356/706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:21 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:22.732870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:22.733465 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:22.741002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:22.741566 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:22.742091 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:22.742894 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:22.743350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:22.743817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:22.891757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:22.900607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2d44d057-184c-4683-a076-74ea50c463a5 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.171589 Aug 22 11:09:22.901181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 357/707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:22 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:23.018836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:23.019436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:23.025239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:23.025926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:23.026386 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:23.027073 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:23.027520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:23.027980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:23.167416 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:23.175860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-970c8523-e4e0-402f-badc-001d2aa657eb tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1509 microversion: 2.1 time: 0.161449 Aug 22 11:09:23.176433 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 358/708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:23 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:23.288466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bb97a678-499b-488a-a9ee-fbb0b5057225 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.678177 Aug 22 11:09:23.289013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 351/709] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:09:19 2022] POST /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments => generated 194 bytes in 3680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:09:23.921034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:23.922910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:23.930215 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:23.930726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:23.931152 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:23.931831 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:23.932304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:23.932715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:24.084109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-59e4d01a-b2b3-4314-bd6c-cc9a92940f73 req-8447b9f5-bcbf-4fc5-adbf-ca4afaabe5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0", "name": "network-vif-deleted", "tag": "5aa72877-eecc-4955-806c-48e0a9b360a8"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:24.089147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:24.096785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-59e4d01a-b2b3-4314-bd6c-cc9a92940f73 req-8447b9f5-bcbf-4fc5-adbf-ca4afaabe5e9 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:24.097494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-59e4d01a-b2b3-4314-bd6c-cc9a92940f73 req-8447b9f5-bcbf-4fc5-adbf-ca4afaabe5e9 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:24.098076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-59e4d01a-b2b3-4314-bd6c-cc9a92940f73 req-8447b9f5-bcbf-4fc5-adbf-ca4afaabe5e9 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:24.098385 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c5683b15-88ec-4d66-8310-96627dc1d1ba tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.181177 Aug 22 11:09:24.099403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 359/710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:23 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:24.110968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-59e4d01a-b2b3-4314-bd6c-cc9a92940f73 req-8447b9f5-bcbf-4fc5-adbf-ca4afaabe5e9 service nova] Creating event network-vif-deleted:5aa72877-eecc-4955-806c-48e0a9b360a8 for instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 on hv-cinder-85394 Aug 22 11:09:24.115770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-59e4d01a-b2b3-4314-bd6c-cc9a92940f73 req-8447b9f5-bcbf-4fc5-adbf-ca4afaabe5e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036257 Aug 22 11:09:24.116415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 352/711] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:24.198601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:24.199211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:24.206125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:24.206671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:24.207109 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:24.207795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:24.208254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:24.208670 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:24.273342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:24.281843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4a95f6c9-9020-4590-988c-ce04d2ec44a0 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 200 len: 1467 microversion: 2.1 time: 0.086225 Aug 22 11:09:24.282418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 360/712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:24 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 1467 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:25.121622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:25.122459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:25.129215 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.130565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.130565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.130827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.131268 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.131690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.137640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:25.363546 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:25.366745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:25.368780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:25.373932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.374567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.380219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.380219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.380219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.380219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.382042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:25.392173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] HTTP exception thrown: Instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 could not be found. Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Request method failure captured: Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 HTTP/1.1 Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K4VPSfrEmSjxqKPp3GzLTG_GldlBtAqF8U7AEJ02UvMsGRiwjuhYgyZ7Mg3TCdeKVJE7oBebf3PBSTNyGQ3GyCvQznzFNRUA7OCBrgPh7oMsQ07BCVXzTNERgNF7JvChaLCeRTClI1YoV3HBTE0FXwpqtnGFn1THAE1P8dmPV3lkw Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:09:25.393833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2cb7651353884366b2ca72a7e272bdc0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 7c6fee0b956e41a7b2d9b914043633ea Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 could not be found. Aug 22 11:09:25.395535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0'} Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 could not be found. Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:09:25.396467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 could not be found. Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 could not be found. Aug 22 11:09:25.397924 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:25.404116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Returning 404 to user: Instance a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:09:25.404116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-47a5e3e0-2c58-45b1-ba5b-8f24113a7f64 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0" status: 404 len: 111 microversion: 2.1 time: 0.097316 Aug 22 11:09:25.404116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 361/713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:25 2022] GET /compute/v2.1/servers/a75ac3b3-25f8-49b5-97bd-e8f1df59c6a0 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 11:09:25.406678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:25.407168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:25.413171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.413715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.414153 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.414892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.415354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.415767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.448183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:09:25.558969 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:25.570388 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-854dee7c-d5b5-40f1-b250-864eb9f74a9d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.453379 Aug 22 11:09:25.571276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 353/714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:25 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:25.761683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d87593c1-d1a3-4a5e-962e-102a9b942953 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "DELETE /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 204 len: 0 microversion: 2.1 time: 0.358486 Aug 22 11:09:25.762530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 362/715] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:09:25 2022] DELETE /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:09:25.770651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:25.771254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:25.777640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.778116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.778575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.779306 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:25.779750 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:25.780168 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:25.920651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:25.929074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d548cd1d-3355-4f6f-a6b8-3729de469dde tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.162467 Aug 22 11:09:25.929638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 354/716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:25 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:26.592009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:26.592697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:26.600473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:26.600956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:26.601389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:26.602086 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:26.602663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:26.603087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:26.737729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:26.745301 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dfefc0d8-552a-420b-b2b7-75959eed76c1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.157524 Aug 22 11:09:26.745862 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 363/717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:26 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:26.950657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:26.951438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:26.957740 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:26.958224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:26.958691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:26.959383 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:26.959873 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:26.960298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:27.090481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:27.098363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-45b27fdd-c761-4c45-bdc8-2665a45c2710 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.151639 Aug 22 11:09:27.099013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 355/718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:26 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:27.766525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:27.767911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:27.774456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:27.774941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:27.775373 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:27.776064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:27.776517 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:27.776943 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:27.920424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:27.928296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-286b8c13-efe6-4ae1-9a55-87067d859473 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.165495 Aug 22 11:09:27.928956 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 364/719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:27 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:28.119844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:28.120396 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:28.127213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:28.127773 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:28.128230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:28.128898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:28.129347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:28.129770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:28.272606 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:28.280198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9e7c45af-4d04-4519-9fc3-3ce6e97e8a4e tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.164293 Aug 22 11:09:28.280889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 356/720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:28 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:28.948807 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:28.955520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:28.972872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:28.973364 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:28.973798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:28.974532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:28.974978 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:28.975398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:29.115144 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:29.123590 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-04737660-a4c0-4240-a95c-05a9dc047dd9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.178557 Aug 22 11:09:29.127347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 365/721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:28 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:29.301277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:29.301865 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:29.308256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:29.308730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:29.309167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:29.309848 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:29.310317 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:29.310735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:29.443713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:29.451479 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-36aeaef5-927f-4160-a374-9dcac7368102 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.154379 Aug 22 11:09:29.452074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 357/722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:29 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:30.144637 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:30.145297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:30.151510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:30.151991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:30.152497 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:30.153532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:30.153992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:30.154447 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:30.283141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:30.290703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0c044745-306e-4b4c-9ac6-36b4b6cca3e1 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.150261 Aug 22 11:09:30.291267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 366/723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:30 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:30.473295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:30.473901 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:30.480212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:30.480683 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:30.481110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:30.481784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:30.482255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:30.482681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:30.609310 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:30.617486 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7f59c49e-d3b6-4032-be5d-6a2c1324da15 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.148557 Aug 22 11:09:30.618052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 358/724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:30 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:31.311475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:31.312082 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:31.318991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:31.319469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:31.319897 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:31.320583 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:31.321057 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:31.321476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:31.456208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:31.463815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-271a1be0-0e95-4e2d-bb5f-af82804abf9f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.156178 Aug 22 11:09:31.464363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 367/725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:31 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:31.638091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:31.638701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:31.645106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:31.645585 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:31.646015 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:31.646734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:31.647184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:31.647606 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:31.774511 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:31.781920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-62c74ca9-4927-4217-a5c5-442fd268aa8a tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.147747 Aug 22 11:09:31.783240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 359/726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:31 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:32.484592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:32.485201 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:32.492156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:32.492639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:32.493073 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:32.493809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:32.494284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:32.494706 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:32.627467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:32.635124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ecee9869-8df1-4ff5-a1ac-e4327942f855 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.154417 Aug 22 11:09:32.635682 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 368/727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:32 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:32.805679 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:32.806342 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:32.816357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:32.817098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:32.817766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:32.818899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:32.819614 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:32.820266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:32.959054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:32.968903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-31480923-55ad-4516-be13-9430c92e86e4 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1522 microversion: 2.1 time: 0.169045 Aug 22 11:09:32.974561 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 360/728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:32 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:32.986929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-6f679945-10e6-42bd-98e3-dea2a7fd8e91 req-82ac09e1-54b1-4ffa-b2e2-ab214e80bcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ff9d5-279f-46b0-977d-98240e33a48b", "name": "network-vif-unplugged", "status": "completed", "tag": "8e13dc94-aa74-48ee-8120-ded9a1b2442f"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:33.000611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6f679945-10e6-42bd-98e3-dea2a7fd8e91 req-82ac09e1-54b1-4ffa-b2e2-ab214e80bcce service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:33.003481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6f679945-10e6-42bd-98e3-dea2a7fd8e91 req-82ac09e1-54b1-4ffa-b2e2-ab214e80bcce service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:33.003481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-6f679945-10e6-42bd-98e3-dea2a7fd8e91 req-82ac09e1-54b1-4ffa-b2e2-ab214e80bcce service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:33.032008 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-6f679945-10e6-42bd-98e3-dea2a7fd8e91 req-82ac09e1-54b1-4ffa-b2e2-ab214e80bcce service nova] Creating event network-vif-unplugged:8e13dc94-aa74-48ee-8120-ded9a1b2442f for instance 819ff9d5-279f-46b0-977d-98240e33a48b on hv-cinder-85394 Aug 22 11:09:33.040769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-6f679945-10e6-42bd-98e3-dea2a7fd8e91 req-82ac09e1-54b1-4ffa-b2e2-ab214e80bcce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057753 Aug 22 11:09:33.042626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 369/729] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:33.531139 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-784b3dd8-d32f-417c-95c0-9f7fe35f87f1 req-edcb6dcc-faee-4146-adc6-17513e924790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ff9d5-279f-46b0-977d-98240e33a48b", "name": "network-vif-deleted", "tag": "8e13dc94-aa74-48ee-8120-ded9a1b2442f"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:33.541035 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-784b3dd8-d32f-417c-95c0-9f7fe35f87f1 req-edcb6dcc-faee-4146-adc6-17513e924790 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:33.541516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-784b3dd8-d32f-417c-95c0-9f7fe35f87f1 req-edcb6dcc-faee-4146-adc6-17513e924790 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:33.541940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-784b3dd8-d32f-417c-95c0-9f7fe35f87f1 req-edcb6dcc-faee-4146-adc6-17513e924790 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:33.553240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-784b3dd8-d32f-417c-95c0-9f7fe35f87f1 req-edcb6dcc-faee-4146-adc6-17513e924790 service nova] Creating event network-vif-deleted:8e13dc94-aa74-48ee-8120-ded9a1b2442f for instance 819ff9d5-279f-46b0-977d-98240e33a48b on hv-cinder-85394 Aug 22 11:09:33.557959 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-784b3dd8-d32f-417c-95c0-9f7fe35f87f1 req-edcb6dcc-faee-4146-adc6-17513e924790 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030446 Aug 22 11:09:33.558574 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 361/730] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:33.662319 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:33.666150 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:33.669825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:33.670341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:33.670778 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:33.671557 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:33.672009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:33.672432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:33.818860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:33.833476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-14298630-fa9c-42eb-a796-be6963ffb40d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.177406 Aug 22 11:09:33.834331 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 370/731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:33 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:33.991623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:33.992315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:33.998617 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:33.999201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:33.999703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.000462 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.000916 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.001941 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.033450 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.033949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.034423 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.034870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lazy-loading 'fault' on Instance uuid 819ff9d5-279f-46b0-977d-98240e33a48b {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:34.080965 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6fee0b956e41a7b2d9b914043633ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb7651353884366b2ca72a7e272bdc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:34.089737 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d22b2605-93bb-4a18-b9d3-47972d29f752 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 200 len: 1312 microversion: 2.1 time: 0.102738 Aug 22 11:09:34.090301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 362/732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:33 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:34.140244 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "685af9d7-742e-4eeb-a93e-3fb6cd0f504c"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:34.143359 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:34.154467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.155103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.155440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.156118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.156564 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.156980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.251763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Invalid volume: volume 685af9d7-742e-4eeb-a93e-3fb6cd0f504c is already attached to instances: 97645244-c78b-40be-82b1-fb4e66a5eaaf Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: POST /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments HTTP/1.1 Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 74 Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:09:34.253563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {"volumeAttachment": {"volumeId": "685af9d7-742e-4eeb-a93e-3fb6cd0f504c"}} Aug 22 11:09:34.255537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Invalid volume: volume 685af9d7-742e-4eeb-a93e-3fb6cd0f504c is already attached to instances: 97645244-c78b-40be-82b1-fb4e66a5eaaf Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'server_id': '97645244-c78b-40be-82b1-fb4e66a5eaaf', 'body': {'volumeAttachment': {'volumeId': '685af9d7-742e-4eeb-a93e-3fb6cd0f504c'}}} Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 685af9d7-742e-4eeb-a93e-3fb6cd0f504c is already attached to instances: 97645244-c78b-40be-82b1-fb4e66a5eaaf Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:34.256262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 685af9d7-742e-4eeb-a93e-3fb6cd0f504c is already attached to instances: 97645244-c78b-40be-82b1-fb4e66a5eaaf Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:34.257487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 685af9d7-742e-4eeb-a93e-3fb6cd0f504c is already attached to instances: 97645244-c78b-40be-82b1-fb4e66a5eaaf Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 400 to user: Invalid volume: volume 685af9d7-742e-4eeb-a93e-3fb6cd0f504c is already attached to instances: 97645244-c78b-40be-82b1-fb4e66a5eaaf {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-525a0d67-c2b1-47b7-a330-fe0f627f7ac4 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118997 Aug 22 11:09:34.258672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 371/733] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:09:34 2022] POST /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:09:34.321057 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:34.321545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:34.327555 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.328029 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.328461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.329135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.330444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.330831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.415935 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'services' on Instance uuid 97645244-c78b-40be-82b1-fb4e66a5eaaf {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:34.644709 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a99f2006-7eac-4420-8f19-36b136ff0a6c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments/685af9d7-742e-4eeb-a93e-3fb6cd0f504c" status: 202 len: 0 microversion: 2.1 time: 0.327423 Aug 22 11:09:34.645421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 363/734] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:09:34 2022] DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments/685af9d7-742e-4eeb-a93e-3fb6cd0f504c => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:34.653845 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:34.656105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:34.665738 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.671934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.671934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.671934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.671934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.672633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.706539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-81c68ea4-c8ef-4672-95fc-70fafa0459f1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056539 Aug 22 11:09:34.707487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 372/735] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:09:34 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:34.855109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:34.855898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:34.863295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.863870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.864373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:34.865150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:34.865661 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:34.866150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.005350 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:35.013140 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b911b030-3bde-4130-a284-c4eb0655d7d0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.162436 Aug 22 11:09:35.018752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 364/736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:34 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:35.117089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:35.117702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] [instance: 819ff9d5-279f-46b0-977d-98240e33a48b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:35.123477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:35.123959 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:35.124393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.125080 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:35.125542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:35.125964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.139721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] HTTP exception thrown: Instance 819ff9d5-279f-46b0-977d-98240e33a48b could not be found. Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Request method failure captured: Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b HTTP/1.1 Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K4VPSfrEmSjxqKPp3GzLTG_GldlBtAqF8U7AEJ02UvMsGRiwjuhYgyZ7Mg3TCdeKVJE7oBebf3PBSTNyGQ3GyCvQznzFNRUA7OCBrgPh7oMsQ07BCVXzTNERgNF7JvChaLCeRTClI1YoV3HBTE0FXwpqtnGFn1THAE1P8dmPV3lkw Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:09:35.141220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2cb7651353884366b2ca72a7e272bdc0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2cb7651353884366b2ca72a7e272bdc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 2cb7651353884366b2ca72a7e272bdc0 Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1257798596 Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 7c6fee0b956e41a7b2d9b914043633ea Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1257798596-project Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 819ff9d5-279f-46b0-977d-98240e33a48b could not be found. Aug 22 11:09:35.142895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '819ff9d5-279f-46b0-977d-98240e33a48b'} Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819ff9d5-279f-46b0-977d-98240e33a48b could not be found. Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:09:35.143758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819ff9d5-279f-46b0-977d-98240e33a48b could not be found. Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819ff9d5-279f-46b0-977d-98240e33a48b could not be found. Aug 22 11:09:35.145277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:35.151069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] Returning 404 to user: Instance 819ff9d5-279f-46b0-977d-98240e33a48b could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:09:35.151069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1a00b375-ed67-444f-b443-bfa0ec4ca899 tempest-ServerRescueNegativeTestJSON-1257798596 tempest-ServerRescueNegativeTestJSON-1257798596-project] 10.222.0.48 "GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b" status: 404 len: 111 microversion: 2.1 time: 0.029828 Aug 22 11:09:35.151069 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 373/737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:35 2022] GET /compute/v2.1/servers/819ff9d5-279f-46b0-977d-98240e33a48b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:09:35.718426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:35.721490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:35.727573 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:35.728123 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:35.728621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.729372 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:35.729876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:35.730323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.760277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b1db4d0-1471-478b-ad53-66fde3a21e68 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045789 Aug 22 11:09:35.764886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 365/738] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:09:35 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:09:35.839192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:35.840389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:35.849985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:35.850509 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:35.850951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.853180 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:35.853659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:35.854104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:35.883257 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:09:36.035698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:36.036959 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:36.045391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:36.046065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:36.046533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:36.047358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:36.047998 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:36.048585 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:36.193639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5abcd912-797d-46f6-a116-d802fdf16af2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 204 len: 0 microversion: 2.1 time: 0.360581 Aug 22 11:09:36.194600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 374/739] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:09:35 2022] DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:09:36.198019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:36.205140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:36.206320 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:36.208081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97674873-acd1-4649-8991-c787c91a676b tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.177886 Aug 22 11:09:36.209093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 366/740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:36 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:36.214465 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:36.215249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:36.218667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:36.218667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:36.218667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:36.218667 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:36.464317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:36.472619 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-039daa38-661e-49c8-91e5-13f43d044e9b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1681 microversion: 2.1 time: 0.272966 Aug 22 11:09:36.473191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 375/741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:36 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:36.852730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-2a09d5e5-97e0-4307-aad8-9afd2f5a1b58 req-24069c89-6edc-4294-9bc7-c0300dc83388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "name": "network-vif-plugged", "status": "completed", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:36.868450 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-2a09d5e5-97e0-4307-aad8-9afd2f5a1b58 req-24069c89-6edc-4294-9bc7-c0300dc83388 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:36.869077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-2a09d5e5-97e0-4307-aad8-9afd2f5a1b58 req-24069c89-6edc-4294-9bc7-c0300dc83388 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:36.870363 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-2a09d5e5-97e0-4307-aad8-9afd2f5a1b58 req-24069c89-6edc-4294-9bc7-c0300dc83388 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:36.884087 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-2a09d5e5-97e0-4307-aad8-9afd2f5a1b58 req-24069c89-6edc-4294-9bc7-c0300dc83388 service nova] Creating event network-vif-plugged:2240a687-7199-4dd1-8568-213265e08ae1 for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 on hv-cinder-85394 Aug 22 11:09:36.889202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-2a09d5e5-97e0-4307-aad8-9afd2f5a1b58 req-24069c89-6edc-4294-9bc7-c0300dc83388 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041075 Aug 22 11:09:36.890264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 367/742] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:37.229315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:37.230616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:37.239573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:37.240015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:37.241108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:37.241817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:37.242446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:37.242777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:37.273176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:37.390966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:37.401898 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6cc8588d-f085-4422-9956-52a501173798 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.176706 Aug 22 11:09:37.402524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 376/743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:37 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:37.495700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:37.496922 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:37.511605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:37.511605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:37.511605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:37.511605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:37.512345 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:37.512345 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:37.806909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:37.816445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f805ac59-afab-4fb4-9525-e79c1be02d6b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1681 microversion: 2.1 time: 0.325348 Aug 22 11:09:37.817066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 368/744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:37 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:38.424866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:38.426276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:38.436034 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:38.436549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:38.437027 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:38.437733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:38.438217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:38.439376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:38.617296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:38.624474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3d3f6667-f3db-4cf5-984a-14df05ce318f tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.204241 Aug 22 11:09:38.627918 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 377/745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:38 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:38.841197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:38.842738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:38.850803 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:38.851393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:38.851899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:38.852679 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:38.857664 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:38.858403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:38.946262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:38.954520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3711bb2f-0065-4f5a-8530-54a7b285b8ac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1613 microversion: 2.1 time: 0.118045 Aug 22 11:09:38.956043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 369/746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:38 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:39.347066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-749bb153-8c10-4ceb-a152-4da0ee9d730d req-cf856e96-c14b-4357-8f41-6699541924c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97645244-c78b-40be-82b1-fb4e66a5eaaf", "name": "network-vif-deleted", "tag": "281fcf26-5e01-4ab8-b0de-af97ac611bdc"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:39.356925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-749bb153-8c10-4ceb-a152-4da0ee9d730d req-cf856e96-c14b-4357-8f41-6699541924c1 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:39.357854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-749bb153-8c10-4ceb-a152-4da0ee9d730d req-cf856e96-c14b-4357-8f41-6699541924c1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:39.358647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-749bb153-8c10-4ceb-a152-4da0ee9d730d req-cf856e96-c14b-4357-8f41-6699541924c1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:39.374108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-749bb153-8c10-4ceb-a152-4da0ee9d730d req-cf856e96-c14b-4357-8f41-6699541924c1 service nova] Creating event network-vif-deleted:281fcf26-5e01-4ab8-b0de-af97ac611bdc for instance 97645244-c78b-40be-82b1-fb4e66a5eaaf on hv-cinder-85394 Aug 22 11:09:39.386944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-749bb153-8c10-4ceb-a152-4da0ee9d730d req-cf856e96-c14b-4357-8f41-6699541924c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043678 Aug 22 11:09:39.388152 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 378/747] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:39.652838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:39.659225 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:39.659963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:39.660629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:39.661216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:39.662091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:39.662571 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:39.663005 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:39.667490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:39.830384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:39.847984 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2401d3be-560f-42bd-9c26-83214280a9c0 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1575 microversion: 2.1 time: 0.190033 Aug 22 11:09:39.847984 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 370/748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:39 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:39.984009 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:39.984846 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:39.992937 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:39.993427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:39.993859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:39.994633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:39.995083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:39.995535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:40.029935 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:40.030511 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:40.030949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:40.031855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid 97645244-c78b-40be-82b1-fb4e66a5eaaf {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:40.103446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:40.114200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b3f88dcb-5726-4ab2-af99-7d3e99629b2c tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 200 len: 1330 microversion: 2.1 time: 0.134473 Aug 22 11:09:40.115398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 379/749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:39 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 1330 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:40.860980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:40.861852 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:40.869307 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:40.869783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:40.870244 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:40.870927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:40.871371 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:40.871785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:41.008283 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:41.016197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a7812153-fd30-4219-b6e3-6cbf851e0dd3 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1562 microversion: 2.1 time: 0.159164 Aug 22 11:09:41.016835 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 371/750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:40 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:41.144101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:41.144812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:41.153456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:41.153456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:41.153880 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:41.154615 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:41.155236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:41.156005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:41.177698 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf HTTP/1.1 Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:09:41.179403 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:09:41.180790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '97645244-c78b-40be-82b1-fb4e66a5eaaf'} Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:09:41.181708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:09:41.190161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:09:41.191520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:09:41.191520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ed7f52f7-2984-44f2-ab69-2c543ca059fb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 404 len: 111 microversion: 2.1 time: 0.050566 Aug 22 11:09:41.191520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 380/751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:41 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:09:41.197168 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e53f9f56-0bd9-40c2-9b69-157595db9fc7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '.version_select at 0x7f3b4c5405e0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:41.252992 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e53f9f56-0bd9-40c2-9b69-157595db9fc7 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301855822" status: 202 len: 0 microversion: 2.1 time: 0.059742 Aug 22 11:09:41.253969 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 372/752] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 22 11:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301855822 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:42.050582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7f792c46-e722-4f91-8ed3-f4e9a92c505e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: .version_select at 0x7f3b50ffea60>, body: {"keypair": {"name": "tempest-keypair-855863468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVkJkGlb4q39yknLKD7GyV1CMCpcfZAA4yw793ZJCQUTUi22ti14KaM3ZDQWxpXLZ3gcho7ihKk91VmBYSm0aDr+MGrXfAhdd2ngUfdT2WsfkqQCcjWgpvRtFBFl/PjXw=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:42.065562 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7f792c46-e722-4f91-8ed3-f4e9a92c505e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:09:42.069339 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-7f792c46-e722-4f91-8ed3-f4e9a92c505e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:09:42.189445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7f792c46-e722-4f91-8ed3-f4e9a92c505e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142807 Aug 22 11:09:42.190444 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 381/753] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:09:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:43.115547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:43.116050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:43.122357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:43.122843 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:43.123290 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:43.124159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:43.124713 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:43.125136 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:43.149963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-94e5786a-a357-4fe5-8016-0dbc89762c54 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/ips" status: 200 len: 151 microversion: 2.20 time: 0.212072 Aug 22 11:09:43.150559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 373/754] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 22 11:09:42 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/ips => generated 151 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:09:43.347745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-43761b91-2be1-4426-815f-2f6f0f61b7a0 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b51053a60>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:43.401972 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-43761b91-2be1-4426-815f-2f6f0f61b7a0 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/84bda94f-d6d1-4ae7-b668-d73d0fee93fe" status: 200 len: 351 microversion: 2.1 time: 0.058589 Aug 22 11:09:43.402601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 382/755] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:09:43 2022] GET /compute/v2.1/os-volumes/84bda94f-d6d1-4ae7-b668-d73d0fee93fe => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:45.139600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2c6d5b2a-d25b-4cba-888b-d47d4f418d42 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c540820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:45.146006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1289386941", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "166e6798-7b1d-482e-a524-1940d4c8d177"}], "security_groups": [{"name": "tempest-securitygroup--1153190143"}], "key_name": "tempest-keypair-855863468", "user_data": "}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:45.200895 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2c6d5b2a-d25b-4cba-888b-d47d4f418d42 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/09b4eae0-aeba-468e-b784-81c943e71eec" status: 200 len: 351 microversion: 2.1 time: 0.064974 Aug 22 11:09:45.201472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 374/756] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:09:45 2022] GET /compute/v2.1/os-volumes/09b4eae0-aeba-468e-b784-81c943e71eec => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:45.312438 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] validate_networks() for [('166e6798-7b1d-482e-a524-1940d4c8d177', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:09:45.354119 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:45.354965 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:45.357003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:45.362844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:45.363114 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:45.363604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:45.364474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:45.365020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:45.365512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:45.390253 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lazy-loading 'flavor' on Instance uuid 8241c043-9b2c-4e9f-bfee-5c17ee42d44b {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:45.907358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:09:45.907976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:09:45.908453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:09:45.908866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:09:45.909278 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:09:45.918011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:45.918530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:45.918969 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:45.919690 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:45.920141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:45.920563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:45.938133 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:09:45.945652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Getting quotas for user a1cdc3bfa3e046fa863131d7ff27d4a1 and project d809822ae9ba4c248d5941746efff780. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:09:45.956791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1033b24c-4a0b-41ea-85e1-b3a753f8c4a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/action" status: 202 len: 0 microversion: 2.20 time: 0.606497 Aug 22 11:09:45.961415 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 375/757] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 22 11:09:45 2022] POST /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:09:45.962280 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:09:45.964534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:09:45.971611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:45.971611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:45.977092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:45.978044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:45.979193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:45.979326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:45.979837 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:45.980256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:46.102819 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-76bb310b-c546-4399-9157-8bfbc2ffb4bd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.961678 Aug 22 11:09:46.107111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 383/758] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:09:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:09:46.118728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9d3a07f5-1ae1-4bc3-9b25-a36f3d6eea4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:46.119352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9d3a07f5-1ae1-4bc3-9b25-a36f3d6eea4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:46.136865 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:46.145377 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:46.146872 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:46.148028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d4d2e4ee-b292-4513-9c52-1917aec3c2b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.185106 Aug 22 11:09:46.148577 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 376/759] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:45 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:09:46.183092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9d3a07f5-1ae1-4bc3-9b25-a36f3d6eea4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:46.193824 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9d3a07f5-1ae1-4bc3-9b25-a36f3d6eea4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1241 microversion: 2.1 time: 0.076088 Aug 22 11:09:46.193824 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 384/760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:46 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:46.956138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a826f70f-e4c1-4cca-b85f-80ad73ceff59 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c5c53a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.004911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a826f70f-e4c1-4cca-b85f-80ad73ceff59 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/21f5cae9-2862-43e9-b66b-b47d45c17705" status: 200 len: 350 microversion: 2.1 time: 0.052705 Aug 22 11:09:47.005734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 377/761] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:09:46 2022] GET /compute/v2.1/os-volumes/21f5cae9-2862-43e9-b66b-b47d45c17705 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:47.018472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b69f83ac-5e6e-4226-a665-297a44a25591 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c6efc10>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.099979 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b69f83ac-5e6e-4226-a665-297a44a25591 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085578 Aug 22 11:09:47.100536 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 385/762] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:47.115273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-028f5e59-6e75-45d4-9f7f-d8d1655d68b5 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c568820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.174927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.175526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:47.181653 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:47.182136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:47.182628 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:47.183375 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:47.183899 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:47.184178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:47.198974 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-028f5e59-6e75-45d4-9f7f-d8d1655d68b5 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088322 Aug 22 11:09:47.199593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 378/763] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:09:47.218101 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9e6e67e3-3ca9-4f80-bef3-f57098f00849 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c59e8b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.304875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9e6e67e3-3ca9-4f80-bef3-f57098f00849 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094352 Aug 22 11:09:47.305506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 379/764] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:47.310111 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-989dab9f-e196-48a8-88b6-8d4d14521f25 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.310753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-989dab9f-e196-48a8-88b6-8d4d14521f25 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:47.328874 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:47.342297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:47.343654 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:47.344864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fa7c8501-13ae-4bab-9f91-848f1d92244a tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.174842 Aug 22 11:09:47.346315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 386/765] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:09:47.351316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c08c6dc3-6be6-4d3e-a5a7-5e2e82910ed3 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c6ef160>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.369490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-989dab9f-e196-48a8-88b6-8d4d14521f25 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:47.376805 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-989dab9f-e196-48a8-88b6-8d4d14521f25 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1241 microversion: 2.1 time: 0.070114 Aug 22 11:09:47.377371 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 380/766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:47.436762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c08c6dc3-6be6-4d3e-a5a7-5e2e82910ed3 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089047 Aug 22 11:09:47.437325 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 387/767] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:47.451149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f68da967-71f3-4c2a-9926-21c254694c7e tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c540dc0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.535725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f68da967-71f3-4c2a-9926-21c254694c7e tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088326 Aug 22 11:09:47.536301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 381/768] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:47.549914 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d8ba83eb-7857-4479-88d7-d68209c1b9bf tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c6c8c10>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.649169 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d8ba83eb-7857-4479-88d7-d68209c1b9bf tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.103602 Aug 22 11:09:47.649737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 388/769] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:47.666903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ddc71019-dd69-4c64-8d57-4d4ad81946f0 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b4c523280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:47.751496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ddc71019-dd69-4c64-8d57-4d4ad81946f0 tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088170 Aug 22 11:09:47.752058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 382/770] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:47.765386 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cb7c138d-dfcc-43ac-a793-aabacf6a703d tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] Calling method '.version_select at 0x7f3b5103e0d0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:48.002716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cb7c138d-dfcc-43ac-a793-aabacf6a703d tempest-VolumesTestJSON-323364738 tempest-VolumesTestJSON-323364738-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.240976 Aug 22 11:09:48.003284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 389/771] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 22 11:09:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:48.369579 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:48.370210 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:48.377041 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:48.377535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:48.377971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:48.378707 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:48.379164 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:48.379590 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:48.398925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:48.399669 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:48.406742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:48.407860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:48.412729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:48.412729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:48.412729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:48.412729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:48.478945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:48.487523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-efb743ba-f4de-48f3-b9e1-a7cdf3172e1b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1301 microversion: 2.1 time: 0.093502 Aug 22 11:09:48.488094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 390/772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:48 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:09:48.583968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:48.592340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:48.596097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:48.596097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-42532b29-e454-48b2-a078-5bd1241fcc3f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.230066 Aug 22 11:09:48.596097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 383/773] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:48 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:09:49.510320 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:49.511184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:49.518551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:49.519178 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:49.519696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:49.520469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:49.521035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:49.521549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:49.618146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:49.624966 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:49.625838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:49.626629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:49.627033 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:49.633428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:49.634210 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:49.634705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:49.689435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:49.698638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bc528557-b563-4a8d-844f-43b5b01be934 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.193346 Aug 22 11:09:49.699370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 391/774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:49 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:49.796627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:49.804806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:49.806341 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:49.807493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a3915f8-67d6-4d67-a25e-43e1ad50884d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.193658 Aug 22 11:09:49.808052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 384/775] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:49 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:09:50.721122 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:50.721790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:50.728190 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:50.728696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:50.729124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:50.729800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:50.730268 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:50.730686 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:50.830931 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:50.831643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:50.837991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:50.838517 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:50.838957 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:50.839654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:50.840109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:50.840533 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:50.866829 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:50.874043 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4aab47b2-4f7e-47fd-8ea0-2e30c78d5add tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.157249 Aug 22 11:09:50.874640 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 392/776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:50 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:50.973959 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:50.981910 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:50.983442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:50.984584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b57a22ff-e552-4c12-9ae5-2667ee5473ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.157780 Aug 22 11:09:50.985127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 385/777] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:50 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:09:51.895719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:51.896309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:51.902736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:51.903221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:51.903658 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:51.904378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:51.904833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:51.905258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:52.008208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:52.008947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:52.015241 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:52.015718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:52.016149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:52.021474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:52.021474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:52.021474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:52.035705 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:52.043198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-055df948-9fb1-45ad-a5f7-74215fd13b48 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.151966 Aug 22 11:09:52.043760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 393/778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:51 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:52.149712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:52.157934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:52.160078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:52.161105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b9c796c0-0d7f-4359-a31e-6b1aff8b63d3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.156881 Aug 22 11:09:52.161654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 386/779] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:52 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:09:53.065965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:53.066721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:53.073504 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:53.074200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:53.075938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:53.075938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:53.076173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:53.076519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:53.222224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-459afef9-ff22-49d6-9e1a-b902314c50f9 req-bf74702a-8626-40bd-8aa8-769ae8bdefc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce", "tag": "45face79-d66a-42e3-90ec-3bc0ad8c4137"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:53.227592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:53.235490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-17a05bad-91e9-46bd-bf91-5fdc8c0c31af tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.174264 Aug 22 11:09:53.236058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 394/780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:53 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:53.239944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-459afef9-ff22-49d6-9e1a-b902314c50f9 req-bf74702a-8626-40bd-8aa8-769ae8bdefc1 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:53.241149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-459afef9-ff22-49d6-9e1a-b902314c50f9 req-bf74702a-8626-40bd-8aa8-769ae8bdefc1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:53.241149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-459afef9-ff22-49d6-9e1a-b902314c50f9 req-bf74702a-8626-40bd-8aa8-769ae8bdefc1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:53.242195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:53.242818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:53.245662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:53.249196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:53.253852 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-459afef9-ff22-49d6-9e1a-b902314c50f9 req-bf74702a-8626-40bd-8aa8-769ae8bdefc1 service nova] Creating event network-changed:45face79-d66a-42e3-90ec-3bc0ad8c4137 for instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce on hv-cinder-85394 Aug 22 11:09:53.258768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:53.258768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:53.258768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:53.258768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:53.259168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:53.260067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-459afef9-ff22-49d6-9e1a-b902314c50f9 req-bf74702a-8626-40bd-8aa8-769ae8bdefc1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183335 Aug 22 11:09:53.261269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 387/781] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:53.396507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:53.405265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:53.407033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:53.408344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1de636a3-ccf3-4ba5-8de7-af3abc21d9a8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.170161 Aug 22 11:09:53.409119 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 395/782] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:53 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:09:54.257878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:54.258612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:54.265525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:54.266033 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:54.266509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:54.267202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:54.267784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:54.268206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:54.411277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:54.418850 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8f3baf24-79a3-4734-b327-e605010048d3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.165289 Aug 22 11:09:54.419429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 388/783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:54 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:54.433764 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:54.434523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:54.441835 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:54.442344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:54.442773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:54.443456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:54.443901 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:54.446865 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:54.622776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:54.632342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:54.633860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:54.635086 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-73430b7f-b6c1-4a3c-82f3-bd141447528c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.206448 Aug 22 11:09:54.635648 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 396/784] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:54 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:09:55.440503 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:55.441145 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:55.447732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:55.448225 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:55.449030 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:55.449902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:55.450387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:55.450824 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:55.586246 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:55.593681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-92ac0692-e090-468b-a45f-389c00404e85 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.157873 Aug 22 11:09:55.594276 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 389/785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:55 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:55.658136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:55.658934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:55.666168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:55.666692 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:55.667128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:55.667901 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:55.668388 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:55.668894 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:55.814535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:55.823651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:55.825147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:55.826321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1d448dfe-4084-4c90-bd26-da9e2f43b5aa tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.172633 Aug 22 11:09:55.826867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 397/786] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:55 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:09:56.614543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:56.615158 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:56.621640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:56.622193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:56.622667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:56.623355 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:56.623808 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:56.624228 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:56.771318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:56.771318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97f64a90-04b1-4694-baa3-877032da9493 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.156936 Aug 22 11:09:56.780745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 390/787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:56 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:56.850944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:56.852129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:56.853987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:56.854705 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=12 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:56.860966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:56.862401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:56.862792 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:56.863679 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:56.864136 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:56.864561 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:57.001282 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:57.009216 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:57.010790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:57.011926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-50783a43-c420-489c-adf0-0609d38b2d4c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.165366 Aug 22 11:09:57.012479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 398/788] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:56 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:09:57.087082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1886334143"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:57.087614 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:57.093392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:57.093878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:57.094320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:57.094996 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:57.095440 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:57.096443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:57.229917 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.network.security_group_api [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Removing security group e7686041-37ac-4480-b8f5-01bae995ecad from port 604f8139-477b-4d71-a631-857498b648e7 Aug 22 11:09:57.373863 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:57.789094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:57.789698 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:57.795769 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:57.796254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:57.796684 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:57.797464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:57.797948 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:57.798367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:57.848518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43b6f8d3-be7f-474d-a2fa-40208c7efba3 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/action" status: 202 len: 0 microversion: 2.1 time: 0.760867 Aug 22 11:09:57.848518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 391/789] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:09:57 2022] POST /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:57.961205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-070c8475-1774-460f-8ae5-6f4d3cd2bf38 req-c05791e5-654b-478c-b725-f754850eb5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:57.971407 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-070c8475-1774-460f-8ae5-6f4d3cd2bf38 req-c05791e5-654b-478c-b725-f754850eb5b6 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:57.972148 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-070c8475-1774-460f-8ae5-6f4d3cd2bf38 req-c05791e5-654b-478c-b725-f754850eb5b6 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:57.972783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-070c8475-1774-460f-8ae5-6f4d3cd2bf38 req-c05791e5-654b-478c-b725-f754850eb5b6 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:57.992266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-070c8475-1774-460f-8ae5-6f4d3cd2bf38 req-c05791e5-654b-478c-b725-f754850eb5b6 service nova] Creating event network-changed:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:09:57.998626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-070c8475-1774-460f-8ae5-6f4d3cd2bf38 req-c05791e5-654b-478c-b725-f754850eb5b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043649 Aug 22 11:09:57.999971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 392/790] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:58.043051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:58.043051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:58.051862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:58.053745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:58.056100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:58.057742 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:58.059201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:58.059860 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:58.108591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:58.128726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-17fac126-ccba-49fb-86e8-76ce25d8ef84 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.341067 Aug 22 11:09:58.143618 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 399/791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:57 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:58.335283 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:58.351076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:58.352764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:58.353954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-633d6dcc-ddc8-48b2-9749-ddc2628c5f8d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.321545 Aug 22 11:09:58.355192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 393/792] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:58 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:09:59.149643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:59.150270 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:59.156611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.157099 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.157534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.158890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.159415 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.159854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.250016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:59.250016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:59.257234 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.257818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.258312 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.259028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.259484 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.260084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.329602 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:59.340538 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a2a9b9a8-1007-4652-a85b-c54a1ca2d224 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.194710 Aug 22 11:09:59.347165 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 400/793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:09:59 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:09:59.367187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:59.377035 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lazy-loading 'services' on Instance uuid 3fce84af-291e-4aa7-be91-34389f4de57c {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:09:59.558912 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-7a97d416-da52-472c-8db9-f55fde85b512 req-b5f8cb37-eb95-495c-bd0a-d97df844be95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:09:59.569139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7a97d416-da52-472c-8db9-f55fde85b512 req-b5f8cb37-eb95-495c-bd0a-d97df844be95 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.569676 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7a97d416-da52-472c-8db9-f55fde85b512 req-b5f8cb37-eb95-495c-bd0a-d97df844be95 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.570115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-7a97d416-da52-472c-8db9-f55fde85b512 req-b5f8cb37-eb95-495c-bd0a-d97df844be95 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.584525 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-7a97d416-da52-472c-8db9-f55fde85b512 req-b5f8cb37-eb95-495c-bd0a-d97df844be95 service nova] Creating event network-changed:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:09:59.589571 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-7a97d416-da52-472c-8db9-f55fde85b512 req-b5f8cb37-eb95-495c-bd0a-d97df844be95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246823 Aug 22 11:09:59.590198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 401/794] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:09:59.595756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:59.596647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:59.603001 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.603697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.604134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.604833 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.605287 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.605710 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.620827 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:09:59.645898 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-af57ddbe-8ffd-43b4-9975-ac564b619efe tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments/23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e" status: 202 len: 0 microversion: 2.1 time: 0.400676 Aug 22 11:09:59.647414 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 394/795] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:09:59 2022] DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments/23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:09:59.656096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:09:59.659051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:09:59.665901 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.666425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.666859 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.667660 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:09:59.668237 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:09:59.668667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:09:59.706906 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-60b99554-3397-44dc-84ab-cb6265bd2234 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054621 Aug 22 11:09:59.707900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 395/796] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:09:59 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:09:59.767122 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:59.776129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:59.777631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:09:59.778823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3559f6bc-8d6f-4625-8af6-b5c47265f027 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.187293 Aug 22 11:09:59.779372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 402/797] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:09:59 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:00.363207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:00.363818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:00.370198 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:00.370708 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:00.371143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:00.371827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:00.372275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:00.372697 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:00.501455 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:00.509178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f9b4b77c-a4e0-4ab1-923f-534dcedb0623 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.151031 Aug 22 11:10:00.509737 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 396/798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:00 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:00.719748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:00.722584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:00.729065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:00.729541 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:00.729970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:00.730685 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:00.731132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:00.731543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:00.760242 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-36734504-6e6a-44f1-b195-a21b9cc72155 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Aug 22 11:10:00.760788 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 403/799] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:10:00 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:00.801481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:00.802085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:00.807967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:00.808474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:00.808910 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:00.809589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:00.810043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:00.810489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:00.941372 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:00.949401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:00.950930 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:00.952096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d920c39b-ac25-48bc-a9ad-79c543f88fc1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.154516 Aug 22 11:10:00.952637 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 397/800] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:00 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:01.541905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:01.542093 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:01.548107 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:01.548584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:01.549907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:01.550629 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:01.551075 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:01.551492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:01.700160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:01.712425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ac7199cb-30c6-4492-b833-1cf03b2236f2 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.174630 Aug 22 11:10:01.713005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 404/801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:01 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:01.773192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:01.775507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:01.781797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:01.782318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:01.782779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:01.783544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:01.784026 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:01.784447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:01.816053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58a4df6c-3432-4b13-a8ee-dd937fa5386c tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046404 Aug 22 11:10:01.816282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 398/802] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:10:01 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:01.976634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:01.977458 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:01.984923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:01.986349 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:01.987100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:01.988166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:01.988860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:01.989401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:02.128379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:02.137090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:02.138784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:02.139988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-10d7bca6-918c-4d6d-8f3b-85e0e5f88353 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.168652 Aug 22 11:10:02.140885 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 405/803] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:01 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:02.734811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:02.735980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:02.744718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:02.745584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:02.746458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:02.747728 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:02.748433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:02.749056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:02.883593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-a7183887-8777-4b4a-a01b-561ab2471bf7 req-136511f2-7ca4-477c-acb9-b4c1f4ef464d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce", "name": "network-vif-plugged", "status": "completed", "tag": "45face79-d66a-42e3-90ec-3bc0ad8c4137"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:02.896396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a7183887-8777-4b4a-a01b-561ab2471bf7 req-136511f2-7ca4-477c-acb9-b4c1f4ef464d service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:02.896888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a7183887-8777-4b4a-a01b-561ab2471bf7 req-136511f2-7ca4-477c-acb9-b4c1f4ef464d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:02.897379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a7183887-8777-4b4a-a01b-561ab2471bf7 req-136511f2-7ca4-477c-acb9-b4c1f4ef464d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:02.914842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-a7183887-8777-4b4a-a01b-561ab2471bf7 req-136511f2-7ca4-477c-acb9-b4c1f4ef464d service nova] Creating event network-vif-plugged:45face79-d66a-42e3-90ec-3bc0ad8c4137 for instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce on hv-cinder-85394 Aug 22 11:10:02.921331 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-a7183887-8777-4b4a-a01b-561ab2471bf7 req-136511f2-7ca4-477c-acb9-b4c1f4ef464d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121519 Aug 22 11:10:02.922637 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 406/804] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:10:02.941755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:02.944426 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:02.947271 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:02.953479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:02.955186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:02.956010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:02.956372 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fe7bdc97-eaa0-4238-93ef-c81031fa8edd tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.226173 Aug 22 11:10:02.957267 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 399/805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:02 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:02.958530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:02.959215 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:02.959818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:03.016004 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-381b8a35-1e5a-475b-93f2-cfd84731aeaa tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091953 Aug 22 11:10:03.016872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 407/806] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:10:02 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:10:03.027750 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:03.028321 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:03.034937 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:03.035430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:03.035866 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:03.036571 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:03.037022 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:03.037438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:03.149751 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] HTTP exception thrown: Instance 3fce84af-291e-4aa7-be91-34389f4de57c is not attached to volume 23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Request method failure captured: Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments/23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e HTTP/1.1 Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Npzjw4wTZiRXBX-Jq8D77KqoXHNlevsFxCX5XyR_YTpoNPH6Dji2ve04RvXaBI5ST2335O772dlmtXovK4RtSxY4traL78BA5A1wh179YOuSuJ-k9lYT85xiFMd4flAvkqLSL_Ro0FP9cT2ugJ_G92A7QUN691CodEa8-XE_iBtVU Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 0533d69c876f4cbdbf6b7138abf37893 Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestMinimumBasicScenario-1947184438 Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:10:03.152171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0533d69c876f4cbdbf6b7138abf37893"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0533d69c876f4cbdbf6b7138abf37893"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0533d69c876f4cbdbf6b7138abf37893", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0533d69c876f4cbdbf6b7138abf37893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestMinimumBasicScenario-1947184438 Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0533d69c876f4cbdbf6b7138abf37893 Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1947184438 Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-TestMinimumBasicScenario-1947184438-project Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 93ec72fc30ea45d5952bf9f29311e4ac Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestMinimumBasicScenario-1947184438-project Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:10:03.153625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 3fce84af-291e-4aa7-be91-34389f4de57c is not attached to volume 23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '3fce84af-291e-4aa7-be91-34389f4de57c', 'id': '23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e'} Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e. Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:10:03.154943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fce84af-291e-4aa7-be91-34389f4de57c is not attached to volume 23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fce84af-291e-4aa7-be91-34389f4de57c is not attached to volume 23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:10:03.156539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Returning 404 to user: Instance 3fce84af-291e-4aa7-be91-34389f4de57c is not attached to volume 23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:10:03.157652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7cb1f1ef-3b3d-4c99-be88-6b2a44be3cb2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments/23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e" status: 404 len: 154 microversion: 2.1 time: 0.130135 Aug 22 11:10:03.157652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 400/807] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:10:03 2022] DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c/os-volume_attachments/23e2637e-f0c3-49f5-bc6f-1ad042c0ca2e => generated 154 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:10:03.163184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:03.163793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:03.169980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:03.170526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:03.170958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:03.171722 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:03.172072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:03.172485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:03.320242 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:03.328380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:03.329899 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:03.331737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7f3aab8f-8b63-4b61-ad38-b6ba3af2e6c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1743 microversion: 2.20 time: 0.172622 Aug 22 11:10:03.332290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 408/808] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:03 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:03.977667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:03.978339 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:03.984752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:03.985226 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:03.985661 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:03.987009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:03.987720 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:03.988142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:04.118189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:04.125819 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-76c1a67f-539a-407e-8fd5-9eda7ea78048 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.151987 Aug 22 11:10:04.126406 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 401/809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:03 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:04.357970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:04.358602 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:04.365988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:04.366445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:04.366888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:04.367580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:04.368035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:04.368459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:04.498847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:04.506853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:04.508367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:04.509521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-18c10761-4443-481a-ac65-4665da09b9eb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1743 microversion: 2.20 time: 0.155509 Aug 22 11:10:04.510079 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 409/810] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:04 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:05.146953 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:05.147557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:05.153954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:05.154476 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:05.154918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:05.155598 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:05.156052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:05.156474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:05.283526 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:05.291708 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-27110fe9-243c-4cb4-bc40-58fc2d9f2d87 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.148679 Aug 22 11:10:05.292298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 402/811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:05 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:05.531967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:05.532573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:05.539486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:05.539998 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:05.542812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:05.543391 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:05.543847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:05.544265 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:05.680626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:05.688596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:05.690129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:05.691304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-730fb223-92dc-4200-86f4-0e1322afa4b3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1743 microversion: 2.20 time: 0.163225 Aug 22 11:10:05.691854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 410/812] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:05 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:06.313050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:06.313651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:06.320092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:06.320610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:06.321036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:06.321712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:06.322156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:06.322604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:06.452688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:06.460274 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-29c75b37-7aef-4243-ab09-6d1b10a246d6 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.151040 Aug 22 11:10:06.460834 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 403/813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:06 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:06.713740 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:06.714459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:06.721481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:06.722836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:06.722836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:06.723246 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:06.723703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:06.724127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:06.854184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:06.862054 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:06.863867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:06.865062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-53e78140-35d8-4ae8-b770-a579fb6f01ad tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1743 microversion: 2.20 time: 0.155306 Aug 22 11:10:06.865611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 411/814] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:06 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:07.480914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:07.481734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:07.488819 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:07.489312 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:07.489724 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:07.490448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:07.490886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:07.491302 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:07.627508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:07.635356 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2dfe7a18-5190-45a3-b0ec-cc9101561c06 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.158211 Aug 22 11:10:07.635891 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 404/815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:07 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:07.887264 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:07.887855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:07.895815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:07.896305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:07.896757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:07.897442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:07.897898 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:07.898351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:08.036798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:08.045500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:08.047341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:08.048500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-77fca6e8-d76d-4d0d-a33e-8fcb3033134f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1743 microversion: 2.20 time: 0.165242 Aug 22 11:10:08.049365 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 412/816] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:07 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:08.663061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:08.664453 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:08.672308 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:08.673159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:08.673828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:08.675845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:08.681324 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:08.681324 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:08.690016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:08.690770 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:08.702494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:08.702494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:08.702494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:08.702494 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:08.702851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:08.702851 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:08.728101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:10:08.827150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:08.839382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-31990b52-2960-48a4-bbeb-a0959cc03fdb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1367 microversion: 2.1 time: 0.181643 Aug 22 11:10:08.841043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 405/817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:08 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:09.072481 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:09.073131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:09.081909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.081909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.081909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:09.082285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.082520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.082944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:09.106379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-70fd16a6-fbbf-4ebf-a24c-e2e90ef96135 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 204 len: 0 microversion: 2.1 time: 0.419456 Aug 22 11:10:09.108755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 413/818] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:10:08 2022] DELETE /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:10:09.118254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:09.118997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:09.125823 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.126582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.128433 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:09.129603 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.130270 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.130985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:09.348681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:09.355389 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:09.357011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-62e0227c-ddfc-442e-abdb-b65d3a7bdbe9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1555 microversion: 2.1 time: 0.245096 Aug 22 11:10:09.358380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 414/819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:09 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:09.367895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-8002bcfa-48b4-4a43-8349-2116c3a0f6b8 req-752710a2-34a3-4a30-b3b4-dcdd8be51885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "name": "network-vif-plugged", "status": "completed", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:09.374448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:09.375553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:09.376781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54c451b3-77ee-45b0-b419-fac5d716482b tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.308315 Aug 22 11:10:09.378531 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 406/820] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:09 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:10:09.405737 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-8002bcfa-48b4-4a43-8349-2116c3a0f6b8 req-752710a2-34a3-4a30-b3b4-dcdd8be51885 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.406326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-8002bcfa-48b4-4a43-8349-2116c3a0f6b8 req-752710a2-34a3-4a30-b3b4-dcdd8be51885 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.406780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-8002bcfa-48b4-4a43-8349-2116c3a0f6b8 req-752710a2-34a3-4a30-b3b4-dcdd8be51885 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:09.419882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-8002bcfa-48b4-4a43-8349-2116c3a0f6b8 req-752710a2-34a3-4a30-b3b4-dcdd8be51885 service nova] Creating event network-vif-plugged:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:10:09.425627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-8002bcfa-48b4-4a43-8349-2116c3a0f6b8 req-752710a2-34a3-4a30-b3b4-dcdd8be51885 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065748 Aug 22 11:10:09.426694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 415/821] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:09.910401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:09.910401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:09.910401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.910401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.911097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:09.911097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:09.911097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:09.911097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.030083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:10.039614 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a692cff3-6704-47da-bc73-8758ce2fd007 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1556 microversion: 2.1 time: 0.181536 Aug 22 11:10:10.040569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 407/822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:09 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:10.062316 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:10.063187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:10.070929 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:10.071608 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:10.072224 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.073108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:10.073566 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:10.073994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.171829 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-04da2778-29f5-41c7-a664-3ce48297a2d1 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113853 Aug 22 11:10:10.181076 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 416/823] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:10:10 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:10.381594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:10.382809 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:10.393866 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:10.395911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:10.395911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.401481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:10.402556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:10.410628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:10.413301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:10.413994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.415955 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:10.416533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:10.417047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.417828 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:10.418485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:10.418984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:10.934706 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:10.947502 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:10.949305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:10.950732 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8c2e5b4c-8f90-4882-8df9-708d31b9af2c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.553736 Aug 22 11:10:10.951471 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 417/824] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:10 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:10:11.115256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:11.126487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-67494a89-208e-4dc1-b753-a694d021d86f tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1555 microversion: 2.1 time: 0.749517 Aug 22 11:10:11.130768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 408/825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:10 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1555 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:11.975267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:11.976521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:11.991267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:11.991793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:11.992434 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:11.993507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:11.994124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:11.998302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:12.146619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-b30d0fef-e76d-44af-85d0-657d9e775274 req-9d92f84e-915d-43f7-877c-961f63122e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce", "tag": "45face79-d66a-42e3-90ec-3bc0ad8c4137"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:12.175032 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b30d0fef-e76d-44af-85d0-657d9e775274 req-9d92f84e-915d-43f7-877c-961f63122e9f service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:12.175831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b30d0fef-e76d-44af-85d0-657d9e775274 req-9d92f84e-915d-43f7-877c-961f63122e9f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:12.177851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b30d0fef-e76d-44af-85d0-657d9e775274 req-9d92f84e-915d-43f7-877c-961f63122e9f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:12.204870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-b30d0fef-e76d-44af-85d0-657d9e775274 req-9d92f84e-915d-43f7-877c-961f63122e9f service nova] Creating event network-changed:45face79-d66a-42e3-90ec-3bc0ad8c4137 for instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce on hv-cinder-85394 Aug 22 11:10:12.215753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-b30d0fef-e76d-44af-85d0-657d9e775274 req-9d92f84e-915d-43f7-877c-961f63122e9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073202 Aug 22 11:10:12.220311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 409/826] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:12.229090 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:12.237511 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:12.256399 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:12.260627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:12.262165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:12.269999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:12.270799 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:12.271362 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:12.281032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:12.291533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:12.296556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:12.303663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e662373d-8736-45a1-8345-f9233634f470 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.334424 Aug 22 11:10:12.304419 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 418/827] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:11 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:12.454112 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:12.481732 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7f35fdba-ceb6-4884-8351-fa87723913bc tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1513 microversion: 2.1 time: 0.259831 Aug 22 11:10:12.488192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 410/828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:12 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:10:13.331527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:13.332916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:13.348850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:13.349363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:13.349805 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:13.350540 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:13.351171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:13.352436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:13.359080 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:13.509082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:13.512042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:13.542000 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:13.544329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:13.549425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:13.549425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:13.549425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:13.549425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:13.594353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:13.639285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:13.640091 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:13.640691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:13.641534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lazy-loading 'fault' on Instance uuid 3fce84af-291e-4aa7-be91-34389f4de57c {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:10:13.719962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ec72fc30ea45d5952bf9f29311e4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0533d69c876f4cbdbf6b7138abf37893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:13.739289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:13.746648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2c34870b-1e59-4b3c-bd76-6add00ad76af tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 200 len: 1348 microversion: 2.1 time: 0.236373 Aug 22 11:10:13.750895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:13.753413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 411/829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:13 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 1348 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:10:13.761888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:13.765353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1573c5d4-3c17-465b-ad00-a6d15b84daa7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.439321 Aug 22 11:10:13.765952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 419/830] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:13 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:14.385109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-076955ad-83d9-4c2d-b594-0fc32521419a req-1dc46f6e-8750-4805-afe4-1ff752686dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce84af-291e-4aa7-be91-34389f4de57c", "name": "network-vif-deleted", "tag": "604f8139-477b-4d71-a631-857498b648e7"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:14.400727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-076955ad-83d9-4c2d-b594-0fc32521419a req-1dc46f6e-8750-4805-afe4-1ff752686dca service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:14.401199 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-076955ad-83d9-4c2d-b594-0fc32521419a req-1dc46f6e-8750-4805-afe4-1ff752686dca service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:14.401626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-076955ad-83d9-4c2d-b594-0fc32521419a req-1dc46f6e-8750-4805-afe4-1ff752686dca service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:14.418537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-076955ad-83d9-4c2d-b594-0fc32521419a req-1dc46f6e-8750-4805-afe4-1ff752686dca service nova] Creating event network-vif-deleted:604f8139-477b-4d71-a631-857498b648e7 for instance 3fce84af-291e-4aa7-be91-34389f4de57c on hv-cinder-85394 Aug 22 11:10:14.428445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-076955ad-83d9-4c2d-b594-0fc32521419a req-1dc46f6e-8750-4805-afe4-1ff752686dca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046993 Aug 22 11:10:14.429642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 412/831] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:14.774925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:14.776724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] [instance: 3fce84af-291e-4aa7-be91-34389f4de57c] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:14.794654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:14.795977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:14.807072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:14.809580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:14.810063 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:14.810529 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:14.816711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:14.817852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:14.818525 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:14.819256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:14.819914 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:14.820366 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:14.825512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:14.826215 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:14.842698 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] HTTP exception thrown: Instance 3fce84af-291e-4aa7-be91-34389f4de57c could not be found. Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Request method failure captured: Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c HTTP/1.1 Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2Npzjw4wTZiRXBX-Jq8D77KqoXHNlevsFxCX5XyR_YTpoNPH6Dji2ve04RvXaBI5ST2335O772dlmtXovK4RtSxY4traL78BA5A1wh179YOuSuJ-k9lYT85xiFMd4flAvkqLSL_Ro0FP9cT2ugJ_G92A7QUN691CodEa8-XE_iBtVU Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 0533d69c876f4cbdbf6b7138abf37893 Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-TestMinimumBasicScenario-1947184438 Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:10:14.854092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0533d69c876f4cbdbf6b7138abf37893"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0533d69c876f4cbdbf6b7138abf37893"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0533d69c876f4cbdbf6b7138abf37893", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0533d69c876f4cbdbf6b7138abf37893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-TestMinimumBasicScenario-1947184438 Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 0533d69c876f4cbdbf6b7138abf37893 Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1947184438 Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-TestMinimumBasicScenario-1947184438-project Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 93ec72fc30ea45d5952bf9f29311e4ac Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-TestMinimumBasicScenario-1947184438-project Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 3fce84af-291e-4aa7-be91-34389f4de57c could not be found. Aug 22 11:10:14.855773 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '3fce84af-291e-4aa7-be91-34389f4de57c'} Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fce84af-291e-4aa7-be91-34389f4de57c could not be found. Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:10:14.856527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fce84af-291e-4aa7-be91-34389f4de57c could not be found. Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fce84af-291e-4aa7-be91-34389f4de57c could not be found. Aug 22 11:10:14.857839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:10:14.859142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Returning 404 to user: Instance 3fce84af-291e-4aa7-be91-34389f4de57c could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:10:14.859142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-f6a32374-328d-4fdf-9955-7c57c51ac8e2 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c" status: 404 len: 111 microversion: 2.1 time: 0.087168 Aug 22 11:10:14.859940 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 420/832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:10:14 2022] GET /compute/v2.1/servers/3fce84af-291e-4aa7-be91-34389f4de57c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:10:14.872533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d057c8f5-ed30-4f6d-80ff-52f277ff5bf9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] Calling method '.version_select at 0x7f3b4c724160>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:14.950014 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d057c8f5-ed30-4f6d-80ff-52f277ff5bf9 tempest-TestMinimumBasicScenario-1947184438 tempest-TestMinimumBasicScenario-1947184438-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1153806202" status: 202 len: 0 microversion: 2.1 time: 0.087944 Aug 22 11:10:14.950951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 421/833] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Aug 22 11:10:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1153806202 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:10:15.007579 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:15.016434 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:15.017936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:15.019164 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1b0fd47-edff-4f04-aeed-1fda837f3f71 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.231646 Aug 22 11:10:15.019716 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 413/834] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:14 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:16.042555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:16.043944 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:16.052845 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:16.055241 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:16.055241 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:16.055241 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:16.055241 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:16.056048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:16.229857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:16.238519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:16.243871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:16.245090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-48f7ce74-99ad-48da-95ba-6ae51712f9a1 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.206839 Aug 22 11:10:16.245662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 422/835] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:16 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:17.274190 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:17.278442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:17.278442 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=72 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:17.283298 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:17.283995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:17.284435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:17.285144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:17.285642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:17.286067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:17.537589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:17.546688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:17.548338 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:17.549569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3eb1e6f4-590f-43b2-a398-90ce1b8aa8fe tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.281082 Aug 22 11:10:17.558045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 414/836] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:17 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:10:18.582125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:18.584159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:18.591617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:18.592321 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:18.592915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:18.597041 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:18.597041 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:18.597041 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:18.785116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:18.793758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:18.795276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:18.796424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-aad39c78-68a9-48d3-8efb-888c0ea19be7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.218111 Aug 22 11:10:18.796969 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 423/837] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:18 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:19.823530 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:19.824323 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:19.833668 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:19.834422 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:19.835054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:19.836769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:19.837391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:19.837969 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:20.008961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:20.022819 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:20.026324 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:20.027797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-83b27ae8-8f9f-486f-b571-a34f824476ef tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.210043 Aug 22 11:10:20.045044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 415/838] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:19 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:21.054220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:21.056061 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:21.063859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:21.076195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:21.080954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:21.081932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:21.083902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:21.084776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:21.290177 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:21.302396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:21.309056 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:21.309056 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c938b7d9-3adf-4b70-902c-5191b7133b3c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.257213 Aug 22 11:10:21.324771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 424/839] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:21 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:22.332870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:22.333691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:22.352115 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:22.352729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:22.355183 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:22.357753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:22.359474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:22.359912 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:22.659944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:22.668649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:22.670150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:22.671365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f5d0a330-dd53-4afe-b7e8-ffe328be97b2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.343730 Aug 22 11:10:22.671927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 416/840] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:22 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:23.695543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:23.696172 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:23.702685 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:23.703166 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:23.703596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:23.704280 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:23.704729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:23.705149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:23.873362 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:23.881543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:23.883059 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:23.884208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c7279a13-96f3-49fc-bd61-d98090c6998e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1738 microversion: 2.20 time: 0.193199 Aug 22 11:10:23.884754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 425/841] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:23 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:24.908191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:24.908795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:24.915457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:24.915931 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:24.916360 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:24.917035 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:24.917477 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:24.917892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:25.147240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:25.157393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:25.160043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:25.161729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-386d1d9a-f207-48e3-8821-c895ddadf4c8 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1720 microversion: 2.20 time: 0.257507 Aug 22 11:10:25.162426 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 417/842] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:24 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:26.184470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:26.185074 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:26.187400 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:26.192357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:26.192641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:26.193254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:26.193946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:26.194439 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:26.194932 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:26.363453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:26.371496 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:26.372984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:26.374128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bf1cb8c4-9a84-41e1-80b2-60b593a072e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1720 microversion: 2.20 time: 0.193568 Aug 22 11:10:26.374707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 426/843] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:26 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:27.397188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:27.397905 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:27.404872 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:27.405357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:27.405789 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:27.406500 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:27.406948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:27.407370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:27.543682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:27.551738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:27.553291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:27.554681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-66bf4c9b-33a5-41f9-a312-a39674a23536 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1720 microversion: 2.20 time: 0.161727 Aug 22 11:10:27.555231 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 418/844] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:27 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:28.577462 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:28.578062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:28.584668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:28.585142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:28.585568 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:28.586263 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:28.586714 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:28.587131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:28.715292 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:28.724364 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:28.725933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:28.727142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d6c163cb-9aa1-42cf-8bbf-b888bdb1cfa2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1720 microversion: 2.20 time: 0.153848 Aug 22 11:10:28.727694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 427/845] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:28 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:29.683116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-0f1cf392-cf63-4388-ac74-7da5f878b52a req-d120a154-82ab-47bf-88a9-f2c4aceb532b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "name": "network-vif-unplugged", "status": "completed", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:29.693780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-0f1cf392-cf63-4388-ac74-7da5f878b52a req-d120a154-82ab-47bf-88a9-f2c4aceb532b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:29.694497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-0f1cf392-cf63-4388-ac74-7da5f878b52a req-d120a154-82ab-47bf-88a9-f2c4aceb532b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:29.694929 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-0f1cf392-cf63-4388-ac74-7da5f878b52a req-d120a154-82ab-47bf-88a9-f2c4aceb532b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:29.705998 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-0f1cf392-cf63-4388-ac74-7da5f878b52a req-d120a154-82ab-47bf-88a9-f2c4aceb532b service nova] Creating event network-vif-unplugged:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:10:29.710955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-0f1cf392-cf63-4388-ac74-7da5f878b52a req-d120a154-82ab-47bf-88a9-f2c4aceb532b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031931 Aug 22 11:10:29.711526 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 419/846] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:29.751277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:29.751882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:29.758097 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:29.758610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:29.759037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:29.759714 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:29.760158 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:29.760572 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:29.913289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:29.921328 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:29.922866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:29.924018 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-47be4d5d-5bab-446a-86c1-6e95e2418774 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1720 microversion: 2.20 time: 0.176728 Aug 22 11:10:29.924816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 428/847] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:29 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:30.948162 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:30.948863 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:30.954989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:30.955476 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:30.955900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:30.956592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:30.957051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:30.957478 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:31.088224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:31.096316 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:31.097812 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:31.099056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e9aab3d-a26a-4a03-a0cf-46dc0c691dbc tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1663 microversion: 2.20 time: 0.156740 Aug 22 11:10:31.099601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 420/848] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:30 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:31.125052 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e961578-dec0-483d-8a0b-79fa5f077a36"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:31.127486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:31.134879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:31.135360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:31.135787 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:31.136478 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:31.136923 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:31.137334 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:32.199755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-23c90baa-a9e3-4474-9f44-c9d458cc5172 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.078946 Aug 22 11:10:32.200363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 429/849] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 22 11:10:31 2022] POST /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-volume_attachments => generated 188 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 11:10:32.323085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:32.323618 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:32.330502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:32.330991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:32.331430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:32.332125 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:32.332591 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:32.333015 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:32.914408 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-508128a8-eb2c-4bf9-8d62-935cd04e4ff4 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-volume_attachments/2e961578-dec0-483d-8a0b-79fa5f077a36" status: 202 len: 0 microversion: 2.20 time: 0.595137 Aug 22 11:10:32.915172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 421/850] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 22 11:10:32 2022] DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-volume_attachments/2e961578-dec0-483d-8a0b-79fa5f077a36 => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:10:32.975081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:32.975669 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:32.981539 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:32.982014 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:32.982477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:32.983159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:32.983600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:32.984012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:33.012795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121143) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 11:10:33.230726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1820f18d-d9df-4ada-8233-6a3d0eb6d452 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "POST /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/action" status: 202 len: 0 microversion: 2.20 time: 0.260366 Aug 22 11:10:33.231440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 430/851] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 22 11:10:32 2022] POST /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:10:33.239985 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:33.240725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:33.246956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:33.247437 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:33.247864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:33.248557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:33.249002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:33.249472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:33.383002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:33.391946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:33.393466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:33.394645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6b94a515-3036-4a0c-8ff2-0d1ed5131d07 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1671 microversion: 2.20 time: 0.158928 Aug 22 11:10:33.395193 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 422/852] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:33 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:10:34.419107 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:34.419716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:34.425832 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:34.426364 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:34.426816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:34.428152 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:34.428643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:34.429070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:34.563267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:34.571735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:34.573231 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:34.574436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-688e790c-88f3-4a0f-86bb-e617ecc5c023 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1671 microversion: 2.20 time: 0.159666 Aug 22 11:10:34.574964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 431/853] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:34 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:35.597076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:35.597678 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:35.604921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:35.605397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:35.605831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:35.606537 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:35.606980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:35.607395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:35.758106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:35.766447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:35.767961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:35.769122 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ca31849d-8a99-4af5-9013-24cd863f15cb tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1671 microversion: 2.20 time: 0.176046 Aug 22 11:10:35.769698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 423/854] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:35 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:36.793909 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:36.794544 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:36.800926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:36.801450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:36.801933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:36.802680 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:36.803135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:36.805167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:36.941335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:36.950042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:36.951590 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:36.952750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-49173d29-6975-495e-b32b-e2bc0db27b6f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.162898 Aug 22 11:10:36.969482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 432/855] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:36 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:37.978335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:37.980517 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:37.991886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:37.992676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:37.993303 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:37.994375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:37.994990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:37.995674 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:38.154516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:38.164983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:38.166788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:38.167975 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-300ed7b6-35ce-4037-9b47-a9356e6db4f7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.194701 Aug 22 11:10:38.168526 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 424/856] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:37 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:39.191442 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:39.191960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:39.198721 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:39.199200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:39.199631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:39.200317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:39.200764 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:39.201181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:39.361112 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:39.365534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:39.378212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:39.384375 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:39.385890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-604a9094-b61d-4d3f-9ed2-cd187dc45e48 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.198398 Aug 22 11:10:39.398249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 433/857] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:39 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:40.410759 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:40.412043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:40.418609 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:40.418879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:40.419379 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:40.420072 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:40.420518 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:40.420938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:40.561794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:40.570457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:40.571959 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:40.573136 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cb236f78-2892-437e-b0c2-192ba271fff6 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.166263 Aug 22 11:10:40.573689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 425/858] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:40 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:41.600983 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:41.602433 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:41.611124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:41.611604 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:41.612035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:41.612727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:41.613168 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:41.613584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:41.745054 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:41.754810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:41.756436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:41.757607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-694125fb-9108-474f-8e7f-f4738bb83ff3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.162613 Aug 22 11:10:41.758376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 434/859] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:41 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:42.781752 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:42.783477 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:42.792131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:42.793050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:42.793829 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:42.794810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:42.795971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:42.796903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:42.829011 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:43.270186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:43.280030 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:43.281558 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:43.282762 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-411c8df2-ed6a-417e-bdfa-bf636c77dc0d tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.504928 Aug 22 11:10:43.283318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 426/860] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:42 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:44.306507 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:44.308660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:44.316511 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:44.317098 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:44.318653 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:44.319347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:44.319798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:44.320243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:44.496409 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:44.505574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:44.507381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:44.508570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4bc5be13-ff58-4217-8eaf-ca09b1461ba3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.207321 Aug 22 11:10:44.509128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 435/861] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:44 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:45.534807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:45.536056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:45.543061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:45.543536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:45.543962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:45.544649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:45.545094 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:45.545508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:45.681612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:45.689696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:45.691247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:45.692420 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-26f67909-9952-4567-9f54-699980f13ace tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.161538 Aug 22 11:10:45.693004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 427/862] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:45 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:46.720336 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:46.720994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:46.727850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:46.728336 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:46.728771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:46.729477 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:46.729934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:46.730382 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:46.865468 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:46.873599 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:46.875129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:46.876277 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2d17fe23-e34e-42bf-90ef-ffbb1f1dc763 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.160169 Aug 22 11:10:46.876826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 436/863] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:46 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:47.900699 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:47.901375 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:47.903645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:10:47.908516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:47.908994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:47.909430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:47.910162 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:47.910657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:47.911704 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:48.046824 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:48.055345 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:48.060069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:48.060069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-635a9193-959a-4d8e-94da-a6072c111a33 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.161512 Aug 22 11:10:48.060069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 428/864] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:47 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:49.081237 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:49.081927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:49.089016 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:49.089534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:49.089965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:49.090689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:49.091135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:49.091554 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:49.227771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:49.235888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:49.237387 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:49.238573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9c0dc74e-2bb0-4999-967d-755ec5815b40 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.161420 Aug 22 11:10:49.241056 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 437/865] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:49 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:50.263546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:50.288385 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:50.288385 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:50.288385 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:50.288385 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:50.288785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:50.288785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:50.288785 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:50.425967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:50.438200 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:50.439779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:50.441052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b8a51452-8055-446c-9126-3c5c1f313b51 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.182033 Aug 22 11:10:50.441637 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 429/866] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:50 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:51.464421 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:51.465049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:51.471397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:51.471889 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:51.472329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:51.473025 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:51.473480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:51.474111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:51.605978 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:51.615081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:51.616661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:51.617836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d2d69955-100c-4439-b159-6bb2bb1c5fe7 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.157414 Aug 22 11:10:51.618428 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 438/867] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:51 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:52.644640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:52.646185 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:52.652689 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:52.653169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:52.653598 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:52.654314 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:52.654780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:52.655179 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:52.696955 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-d7a92d02-88b3-49fa-98ae-ecb096aa6b2b req-504d139c-a0fb-499a-b617-348c63f49af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "name": "network-vif-plugged", "status": "completed", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:52.710920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d7a92d02-88b3-49fa-98ae-ecb096aa6b2b req-504d139c-a0fb-499a-b617-348c63f49af5 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:52.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d7a92d02-88b3-49fa-98ae-ecb096aa6b2b req-504d139c-a0fb-499a-b617-348c63f49af5 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:52.712054 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-d7a92d02-88b3-49fa-98ae-ecb096aa6b2b req-504d139c-a0fb-499a-b617-348c63f49af5 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:52.725091 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-d7a92d02-88b3-49fa-98ae-ecb096aa6b2b req-504d139c-a0fb-499a-b617-348c63f49af5 service nova] Creating event network-vif-plugged:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:10:52.730715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-d7a92d02-88b3-49fa-98ae-ecb096aa6b2b req-504d139c-a0fb-499a-b617-348c63f49af5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040076 Aug 22 11:10:52.731338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 439/868] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:10:52.790902 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:52.802013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:52.803600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:52.809975 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-881ff914-5eff-4bbb-971e-40f6f19499c0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.169167 Aug 22 11:10:52.821645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 430/869] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:52 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:53.836110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:53.836853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:53.842994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:53.843469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:53.843902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:53.844579 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:53.845026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:53.845472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:53.979252 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:53.987584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:53.989087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:53.990549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1ca45536-07f7-4de3-a1fc-f1f437bc1972 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.159398 Aug 22 11:10:53.991091 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 440/870] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:53 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:55.013054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:55.013601 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:55.020053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:55.021212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:55.021212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:55.022218 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:55.022721 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:55.023178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:55.159393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:55.168270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:55.169845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:55.171274 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-005de0f6-d454-4271-b3ba-e07b2d44b9e5 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1729 microversion: 2.20 time: 0.162228 Aug 22 11:10:55.171864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 431/871] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:55 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:56.195739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:56.196386 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:56.202724 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:56.205749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:56.205749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:56.205749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:56.205749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:56.206091 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:56.332402 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:10:56.332909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:56.340263 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:56.340946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:56.341087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:56.341391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:56.342100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:56.342592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:56.343412 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:56.350451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:56.352914 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:10:56.354617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7b2640d3-706a-4921-bd89-bb92060a8688 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1716 microversion: 2.20 time: 0.163287 Aug 22 11:10:56.355240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 441/872] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:10:56 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:10:56.373405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e9595d45-7b8b-4d5c-94e7-4f133ed19423 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/ips" status: 200 len: 149 microversion: 2.1 time: 0.047656 Aug 22 11:10:56.379749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 432/873] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:10:56 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:10:58.086772 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ced4452e-5f35-441e-8f03-50c658a6d0bc"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:10:58.093021 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:10:58.095918 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:58.096348 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:58.096905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:58.097472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:10:58.097930 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:10:58.098391 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:10:58.827878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6a38a0c3-c676-49b8-8d2c-49083ba96f04 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "POST /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745507 Aug 22 11:10:58.828436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 442/874] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:10:58 2022] POST /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:06.476961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:06.477461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:06.479914 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=9 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:06.480565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=36 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:06.485177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:06.490988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:06.490988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:06.490988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:06.490988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:06.492262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:06.580940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'services' on Instance uuid e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:11:06.797003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c518d86-40eb-49ff-bdc6-4b29ec5e5692 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments/ced4452e-5f35-441e-8f03-50c658a6d0bc" status: 202 len: 0 microversion: 2.1 time: 0.324446 Aug 22 11:11:06.798172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 433/875] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:11:06 2022] DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments/ced4452e-5f35-441e-8f03-50c658a6d0bc => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:11:06.807785 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:06.810989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:06.817126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:06.820534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:06.824204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:06.824204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:06.824204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:06.824204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:06.824603 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:06.855660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d5caa73a-1c56-40cd-a2b4-75f84f8fb9ad tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053111 Aug 22 11:11:06.856230 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 443/876] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:11:06 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:06.996733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-28e10382-aa0c-4796-bbc7-0b1011e2a247 req-f332e056-6bcf-4cec-a602-3e69fa65ab14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:07.000989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:07.001565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:07.007239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-28e10382-aa0c-4796-bbc7-0b1011e2a247 req-f332e056-6bcf-4cec-a602-3e69fa65ab14 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.008118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-28e10382-aa0c-4796-bbc7-0b1011e2a247 req-f332e056-6bcf-4cec-a602-3e69fa65ab14 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.008582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-28e10382-aa0c-4796-bbc7-0b1011e2a247 req-f332e056-6bcf-4cec-a602-3e69fa65ab14 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.009514 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.010004 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.010490 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.011381 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.011837 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.013279 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.023649 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-28e10382-aa0c-4796-bbc7-0b1011e2a247 req-f332e056-6bcf-4cec-a602-3e69fa65ab14 service nova] Creating event network-changed:2240a687-7199-4dd1-8568-213265e08ae1 for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 on hv-cinder-85394 Aug 22 11:11:07.030852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-28e10382-aa0c-4796-bbc7-0b1011e2a247 req-f332e056-6bcf-4cec-a602-3e69fa65ab14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036718 Aug 22 11:11:07.030852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 444/877] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:07.040496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:11:07.281264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7c86735e-4fb0-440c-81fe-dcd16258e2e9 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 204 len: 0 microversion: 2.1 time: 0.292682 Aug 22 11:11:07.282028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 434/878] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:11:06 2022] DELETE /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:11:07.291380 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:07.292078 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:07.299255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.299745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.300173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.300871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.301320 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.301747 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.463350 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:07.471118 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bd0c99aa-0422-42ed-85c0-f7ead45d8533 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.184779 Aug 22 11:11:07.471683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 445/879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:07 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:07.871216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:07.873831 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:07.880421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.880940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.887078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.887078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:07.887078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:07.887078 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:07.916738 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f0876c1c-ad3a-4636-a376-ff4e7a2c02ed tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051937 Aug 22 11:11:07.917309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 435/880] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:11:07 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:08.493281 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:08.493890 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:08.500223 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:08.500699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:08.501131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:08.501818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:08.502289 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:08.505716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:08.652335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:08.661481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-57de655f-1ee2-427f-be09-1a38af6d401d tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1568 microversion: 2.1 time: 0.172729 Aug 22 11:11:08.662470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 446/881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:08 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:08.929492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:08.932051 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:08.938376 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:08.938864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:08.939510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:08.940214 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:08.940671 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:08.941257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:08.974609 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8ae0042a-4fed-4686-af93-c4c27bf2a265 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049341 Aug 22 11:11:08.975186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 436/882] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:11:08 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:09.683122 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:09.688577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:09.691150 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:09.691867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:09.692370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:09.693728 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-214eb260-f33e-4850-8fb0-2dc4ac3f5395 req-494245b5-90e7-422f-b50d-bd6da71f699a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaba33f3-aef7-422c-a8f9-0e117100b0f3", "name": "network-vif-deleted", "tag": "2240a687-7199-4dd1-8568-213265e08ae1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:09.693938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:09.695024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:09.695521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:09.703572 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-214eb260-f33e-4850-8fb0-2dc4ac3f5395 req-494245b5-90e7-422f-b50d-bd6da71f699a service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:09.704043 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-214eb260-f33e-4850-8fb0-2dc4ac3f5395 req-494245b5-90e7-422f-b50d-bd6da71f699a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:09.704469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-214eb260-f33e-4850-8fb0-2dc4ac3f5395 req-494245b5-90e7-422f-b50d-bd6da71f699a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:09.719245 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-214eb260-f33e-4850-8fb0-2dc4ac3f5395 req-494245b5-90e7-422f-b50d-bd6da71f699a service nova] Creating event network-vif-deleted:2240a687-7199-4dd1-8568-213265e08ae1 for instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 on hv-cinder-85394 Aug 22 11:11:09.725020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-214eb260-f33e-4850-8fb0-2dc4ac3f5395 req-494245b5-90e7-422f-b50d-bd6da71f699a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035133 Aug 22 11:11:09.726177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 437/883] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:11:09.777950 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:09.786782 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c81edc74-af1a-4d64-a47d-fbb8072c4fd6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1381 microversion: 2.1 time: 0.107832 Aug 22 11:11:09.787580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 447/884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:09 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1381 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:09.988118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:09.991842 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:09.999146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:09.999634 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.000067 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.000778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.001252 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.001676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.041273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2588ddc9-2b7f-4a43-bf5b-c029338e868b tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057628 Aug 22 11:11:10.041863 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 438/885] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:11:09 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:11:10.111830 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:10.112348 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:10.119000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.122472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.122472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.122472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.122472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.122877 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.146537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:11:10.263055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:10.430609 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-54b7821b-5161-4f53-94f0-3787435a9a4e tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 204 len: 0 microversion: 2.1 time: 0.322338 Aug 22 11:11:10.431520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 448/886] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:11:10 2022] DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:11:10.439616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:10.440487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:10.447515 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.448247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.448880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.449605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.450076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.450526 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.588463 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:10.596423 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0a31a6f7-e1fd-4436-89fc-c6b042ee1eac tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1681 microversion: 2.1 time: 0.160678 Aug 22 11:11:10.601255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 439/887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:10 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:10.808994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:10.809750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:10.816527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.817003 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.817793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.818092 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.818554 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.818991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.858972 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:10.859464 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:10.859947 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:10.866902 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lazy-loading 'fault' on Instance uuid aaba33f3-aef7-422c-a8f9-0e117100b0f3 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:11:10.911869 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:10.921123 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-892693a7-fb3a-4ce9-bded-e7ef970eb771 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1222 microversion: 2.1 time: 0.116452 Aug 22 11:11:10.921815 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 449/888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:10 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:11.135037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:11:11.135616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Mon Aug 22 11:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:11:11.619095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:11.619703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:11.625747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:11.626224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:11.626685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:11.627388 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:11.627876 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:11.628327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:11.760779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:11.768464 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-16f92846-38ad-4375-91da-62bd9612fccb tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1681 microversion: 2.1 time: 0.154166 Aug 22 11:11:11.769017 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 440/889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:11 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:11.942456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:11.943068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:11.949900 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:11.950417 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:11.950850 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:11.951535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:11.951989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:11.952412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:11.983871 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:11.984373 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:11.984797 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:11.985258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lazy-loading 'fault' on Instance uuid aaba33f3-aef7-422c-a8f9-0e117100b0f3 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:11:12.030487 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5e17020ce0436ca26936c73c4d4514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e01f19882d4b6eb2498d59aa8ad78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:12.038842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3b271f58-05fb-4f14-b774-586f556c0893 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 200 len: 1222 microversion: 2.1 time: 0.099652 Aug 22 11:11:12.039404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 450/890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:11 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:12.789103 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:12.789712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:12.796278 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:12.796757 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:12.797187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:12.797875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:12.798352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:12.798770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:13.002520 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:13.011488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c0e9b211-6660-4d88-beb3-1d013d625281 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1681 microversion: 2.1 time: 0.226280 Aug 22 11:11:13.012144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 441/891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:12 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:13.059361 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:13.060147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] [instance: aaba33f3-aef7-422c-a8f9-0e117100b0f3] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:13.066575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:13.067064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:13.067522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:13.068339 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:13.068987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:13.069483 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:13.086036 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] HTTP exception thrown: Instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 could not be found. Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Request method failure captured: Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 HTTP/1.1 Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2L--4mDeMVdANnspObP_POhc0hJODj8iLi5Eeu7U10mWqIt8f32hQda1K2Vd49dtNhYYP57HGokwfGIBZrqOmMemEHXtaWdHbZtj2ujC-5z4HeOfbsCcBrddI2OHLnroWh71u1l4LKb3-Cbv54ePLlTQJSXpOVM7BNxXkh2k3q1eEg Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: e7e01f19882d4b6eb2498d59aa8ad78f Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-TestShelveInstance-727751332 Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:13.087755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7e01f19882d4b6eb2498d59aa8ad78f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e7e01f19882d4b6eb2498d59aa8ad78f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e7e01f19882d4b6eb2498d59aa8ad78f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e7e01f19882d4b6eb2498d59aa8ad78f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-TestShelveInstance-727751332 Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: e7e01f19882d4b6eb2498d59aa8ad78f Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-TestShelveInstance-727751332 Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-TestShelveInstance-727751332-project Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: ce5e17020ce0436ca26936c73c4d4514 Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-TestShelveInstance-727751332-project Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 could not be found. Aug 22 11:11:13.089405 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'aaba33f3-aef7-422c-a8f9-0e117100b0f3'} Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 could not be found. Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:13.091251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 could not be found. Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 could not be found. Aug 22 11:11:13.093077 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:13.094545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Returning 404 to user: Instance aaba33f3-aef7-422c-a8f9-0e117100b0f3 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:13.094545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-33cff96e-010a-43b0-aae2-5c26477470f6 tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3" status: 404 len: 111 microversion: 2.1 time: 0.034325 Aug 22 11:11:13.094545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 451/892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:13 2022] GET /compute/v2.1/servers/aaba33f3-aef7-422c-a8f9-0e117100b0f3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:13.245897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-33eccf60-c75d-423a-a0a1-d9ee694015ea req-55a35e5c-cb31-4a15-989b-05adfee6dd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce", "name": "network-vif-deleted", "tag": "45face79-d66a-42e3-90ec-3bc0ad8c4137"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:13.255905 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-33eccf60-c75d-423a-a0a1-d9ee694015ea req-55a35e5c-cb31-4a15-989b-05adfee6dd09 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:13.256672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-33eccf60-c75d-423a-a0a1-d9ee694015ea req-55a35e5c-cb31-4a15-989b-05adfee6dd09 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:13.257966 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-33eccf60-c75d-423a-a0a1-d9ee694015ea req-55a35e5c-cb31-4a15-989b-05adfee6dd09 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:13.269731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-33eccf60-c75d-423a-a0a1-d9ee694015ea req-55a35e5c-cb31-4a15-989b-05adfee6dd09 service nova] Creating event network-vif-deleted:45face79-d66a-42e3-90ec-3bc0ad8c4137 for instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce on hv-cinder-85394 Aug 22 11:11:13.275277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-33eccf60-c75d-423a-a0a1-d9ee694015ea req-55a35e5c-cb31-4a15-989b-05adfee6dd09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Aug 22 11:11:13.275936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 442/893] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:13.378587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a5a116c4-52f6-42ad-952d-503315125bcd tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] Calling method '.version_select at 0x7f3b50fb4dc0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:13.504131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a5a116c4-52f6-42ad-952d-503315125bcd tempest-TestShelveInstance-727751332 tempest-TestShelveInstance-727751332-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-64800378" status: 202 len: 0 microversion: 2.1 time: 0.129547 Aug 22 11:11:13.504723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 452/894] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-64800378 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:11:14.035877 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:14.037062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:14.047534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:14.048206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:14.048845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:14.053201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:14.053201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:14.053201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:14.098711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:14.099362 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:14.101153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:14.102073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lazy-loading 'fault' on Instance uuid e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:11:14.161920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1cdc3bfa3e046fa863131d7ff27d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd809822ae9ba4c248d5941746efff780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:14.173747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6d594fa8-6287-4f48-90d4-353b80691c2a tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 200 len: 1331 microversion: 2.1 time: 0.142480 Aug 22 11:11:14.174368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 443/895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:14 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:15.199073 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:15.199705 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:15.357800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:15.358540 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:15.358967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:15.359691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:15.360882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:15.361322 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:15.375584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce HTTP/1.1 Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:15.377130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:15.378763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce'} Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:15.379678 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:15.380938 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:15.383121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:15.383121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cc1ea314-c285-4249-b25d-f5996daff6dc tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 404 len: 111 microversion: 2.1 time: 0.184126 Aug 22 11:11:15.383121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 453/896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:15 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:15.388643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f615e026-8cc8-465c-a22d-745496e475b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '.version_select at 0x7f3b4c540c10>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:15.476565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f615e026-8cc8-465c-a22d-745496e475b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-855863468" status: 202 len: 0 microversion: 2.1 time: 0.091043 Aug 22 11:11:15.477169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 444/897] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 22 11:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-855863468 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:11:18.147372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:18.148506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:18.155195 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:18.155725 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:18.156302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:18.157007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:18.157465 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:18.158028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:18.172731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce HTTP/1.1 Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:18.174354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.175928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce'} Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:18.176731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.178066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.179729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:18.179729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-093ea812-950d-4f4b-92db-e43ace7d39b5 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 404 len: 111 microversion: 2.1 time: 0.032212 Aug 22 11:11:18.179729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 454/898] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:11:18 2022] DELETE /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:18.184940 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:18.185556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:18.192848 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:18.193337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:18.193779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:18.194605 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:18.195740 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:18.196184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:18.209628 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce HTTP/1.1 Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:18.212445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.213741 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce'} Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:18.214544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. Aug 22 11:11:18.216861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:18.218493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:18.218493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7ee3551c-f752-4fbf-b369-3d7f25d73c6f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce" status: 404 len: 111 microversion: 2.1 time: 0.032830 Aug 22 11:11:18.218493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 445/899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:18 2022] GET /compute/v2.1/servers/e1c4d534-05a4-4ae5-90e1-6f3ec7cb3cce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:19.551491 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:19.552053 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:19.559023 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.559523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.560149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.561006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.561663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.562160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.577138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf HTTP/1.1 Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:19.578758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.580372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '97645244-c78b-40be-82b1-fb4e66a5eaaf'} Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:19.581381 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.582768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.584810 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:19.586314 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5293b987-7521-47dc-9b80-6704f8f4ce1f tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 404 len: 111 microversion: 2.1 time: 0.038908 Aug 22 11:11:19.587203 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 455/900] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:11:19 2022] DELETE /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:19.597122 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:19.598066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 97645244-c78b-40be-82b1-fb4e66a5eaaf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:19.607258 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.613206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.613206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.613206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.613206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.613920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.626213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf HTTP/1.1 Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:19.627990 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.629547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '97645244-c78b-40be-82b1-fb4e66a5eaaf'} Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:19.630429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. Aug 22 11:11:19.631861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.634988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 97645244-c78b-40be-82b1-fb4e66a5eaaf could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:19.634988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b77a2b34-9f75-4db5-b867-b4e5adf6b256 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf" status: 404 len: 111 microversion: 2.1 time: 0.038214 Aug 22 11:11:19.634988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 446/901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:19 2022] GET /compute/v2.1/servers/97645244-c78b-40be-82b1-fb4e66a5eaaf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 11:11:19.639184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:19.639749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:19.649159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.649159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.649159 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.649715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.650641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.651068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.665789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 HTTP/1.1 Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:19.667429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.668820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '56b9e6d6-e6f5-46d0-8304-e309558d2819'} Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:19.669587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.670825 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.672258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:19.672258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-21a18dc6-84da-4023-aca4-2c7525e5747d tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 404 len: 111 microversion: 2.1 time: 0.036157 Aug 22 11:11:19.672258 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 456/902] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:11:19 2022] DELETE /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:19.681107 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:19.684313 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 56b9e6d6-e6f5-46d0-8304-e309558d2819] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:19.688022 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.688521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.688963 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.689672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:19.690143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:19.690646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:19.705660 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 HTTP/1.1 Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:19.707239 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.708600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '56b9e6d6-e6f5-46d0-8304-e309558d2819'} Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:19.709337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. Aug 22 11:11:19.710652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:19.711681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 56b9e6d6-e6f5-46d0-8304-e309558d2819 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:19.711681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a5e968d-9848-4988-b4d5-c8e56a11c5cf tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819" status: 404 len: 111 microversion: 2.1 time: 0.033426 Aug 22 11:11:19.715044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 447/903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:19 2022] GET /compute/v2.1/servers/56b9e6d6-e6f5-46d0-8304-e309558d2819 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:21.026376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:21.028119 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:21.037284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:21.042610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:21.042610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:21.042610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:21.042610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:21.042957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:21.058547 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 HTTP/1.1 Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:21.060761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.066641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '5ff96ff0-c3fa-48a3-8483-065985f353b2'} Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:21.067748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.069212 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.071709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:21.081188 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ccc386ce-3899-4924-b744-8def3f53d1b3 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 404 len: 111 microversion: 2.1 time: 0.059546 Aug 22 11:11:21.081968 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 457/904] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:11:21 2022] DELETE /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:21.094806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:21.095494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] [instance: 5ff96ff0-c3fa-48a3-8483-065985f353b2] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:21.102547 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:21.103031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:21.103465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:21.104167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:21.104615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:21.105222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:21.120878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] HTTP exception thrown: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Request method failure captured: Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 HTTP/1.1 Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K8coG5c3LT7AenwO8ORaI6lVLPswAfRMshaRYzgXUovlGhifzcjUrFLGSo4RZyZAuV3fMLgB-qaW2wWloEXSXHgtDYcFQ47hnFrdV7JpuLqHTExwCc_0TeZL5ZY7LCB_D9aNIiDHaXmkBHP_WFJmVIsZpQgPRlKfuKJf05gfU6moA Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:21.122438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d809822ae9ba4c248d5941746efff780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d809822ae9ba4c248d5941746efff780", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d809822ae9ba4c248d5941746efff780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d809822ae9ba4c248d5941746efff780 Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838451161 Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: a1cdc3bfa3e046fa863131d7ff27d4a1 Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-838451161-project Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.124132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '5ff96ff0-c3fa-48a3-8483-065985f353b2'} Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:21.125129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. Aug 22 11:11:21.126443 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:21.128441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] Returning 404 to user: Instance 5ff96ff0-c3fa-48a3-8483-065985f353b2 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:21.128441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4da59500-4f45-464d-b37f-f1ca8294a026 tempest-AttachVolumeNegativeTest-838451161 tempest-AttachVolumeNegativeTest-838451161-project] 10.222.0.48 "GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2" status: 404 len: 111 microversion: 2.1 time: 0.033001 Aug 22 11:11:21.128441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 448/905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:21 2022] GET /compute/v2.1/servers/5ff96ff0-c3fa-48a3-8483-065985f353b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:27.659985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-92c2afd9-16b2-4509-930a-39dd34837d95 tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Action: 'create', calling method: .version_select at 0x7f3b4c6a5280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1529927323", "metadata": {"Type": "work"}}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:28.568736 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-92c2afd9-16b2-4509-930a-39dd34837d95 tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.052575 Aug 22 11:11:28.569479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 458/906] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 22 11:11:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1054 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 11:11:28.583014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8634219e-5b65-4fd9-8caa-cdf8470d681f tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Calling method '.version_select at 0x7f3b4c7dc160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:28.651828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8634219e-5b65-4fd9-8caa-cdf8470d681f tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2" status: 200 len: 353 microversion: 2.1 time: 0.072902 Aug 22 11:11:28.652556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 449/907] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:11:28 2022] GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:29.445413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:29.449329 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:29.456068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:29.456900 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:29.457573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:29.466068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:29.466905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:29.467591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:29.510142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7c7fd0c3-56e4-4835-a47b-ba2ebcb2b1ee tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069376 Aug 22 11:11:29.518735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 459/908] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 22 11:11:29 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:29.582833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:29.583853 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:29.595931 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:29.596795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:29.597508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:29.598557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:29.599635 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:29.600287 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:29.630531 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:11:29.667344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3d760715-c883-4ff5-8c20-229f6978370d tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Calling method '.version_select at 0x7f3b5103bf70>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:29.723529 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3d760715-c883-4ff5-8c20-229f6978370d tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2" status: 200 len: 354 microversion: 2.1 time: 0.061195 Aug 22 11:11:29.732296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 460/909] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:11:29 2022] GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:29.737214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d2557768-b799-4aef-bf53-e7832774dcdd tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Calling method '.version_select at 0x7f3b4c6a50d0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:29.798795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d2557768-b799-4aef-bf53-e7832774dcdd tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2" status: 200 len: 354 microversion: 2.1 time: 0.065289 Aug 22 11:11:29.799645 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 461/910] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:11:29 2022] GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:29.818412 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-05f94364-0010-4931-9173-1c79a25e38a2 tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Calling method '.version_select at 0x7f3b4c6a51f0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:29.899952 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4d44924e-e291-407b-9c6f-574cdadb517e tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 204 len: 0 microversion: 2.20 time: 0.322903 Aug 22 11:11:29.900737 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 450/911] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 22 11:11:29 2022] DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 11:11:29.909440 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:29.910133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:29.917948 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:29.918502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:29.918958 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:29.919655 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:29.920128 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:29.920719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:29.926603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:30.025363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-05f94364-0010-4931-9173-1c79a25e38a2 tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2" status: 202 len: 0 microversion: 2.1 time: 0.210778 Aug 22 11:11:30.026205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 462/912] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:11:29 2022] DELETE /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 11:11:30.035500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-cb736e47-2baf-4857-aa39-677c93b3da3a tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Calling method '.version_select at 0x7f3b4c6a5040>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:30.086293 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-cb736e47-2baf-4857-aa39-677c93b3da3a tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2" status: 200 len: 353 microversion: 2.1 time: 0.054975 Aug 22 11:11:30.087128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 463/913] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:11:30 2022] GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:11:30.128676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:30.138273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:30.139778 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:30.140988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-12390c7b-4a4b-4aff-8c6b-5e7d29d629d0 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.235720 Aug 22 11:11:30.141696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 451/914] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:29 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 11:11:31.100907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ad3d8d34-22da-45be-bfa2-a4016c4f3afa tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Calling method '.version_select at 0x7f3b5103baf0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:31.141108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-ad3d8d34-22da-45be-bfa2-a4016c4f3afa tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] HTTP exception thrown: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ad3d8d34-22da-45be-bfa2-a4016c4f3afa tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Request method failure captured: Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 HTTP/1.1 Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2Rfm9zjSHkW1o4vq7fzfiyKC5-7aXdEtJOT-OOHrlv6NXJRP-g2EjurEDU4S5mVx6OB8tjF3_af54xQjpp4NHjLoPvMpRIzygEepaC1HAJsv1NYw6RHxGfTwACYg5tvnQPBCFkzFUGxLlRw0u8zyOEfyS-jdzmIXcoyaFykzuoJ7_w Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 89b78a516ab845659140d1bc70d567af Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-VolumesGetTestJSON-180227003 Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:31.143746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89b78a516ab845659140d1bc70d567af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89b78a516ab845659140d1bc70d567af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89b78a516ab845659140d1bc70d567af", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89b78a516ab845659140d1bc70d567af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-VolumesGetTestJSON-180227003 Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 89b78a516ab845659140d1bc70d567af Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-VolumesGetTestJSON-180227003 Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-VolumesGetTestJSON-180227003-project Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: dd9fac43ae77477d9415306947bb19a9 Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-VolumesGetTestJSON-180227003-project Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '2de89ca9-14f3-4e83-9dad-393c012b39d2'} Aug 22 11:11:31.145111 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. (HTTP 404) (Request-ID: req-3c26e2c7-cae3-4f0d-9ca0-e3bee638e9ff) Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:31.145957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 11:11:31.147297 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 11:11:31.148689 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ad3d8d34-22da-45be-bfa2-a4016c4f3afa tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] Returning 404 to user: Volume 2de89ca9-14f3-4e83-9dad-393c012b39d2 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ad3d8d34-22da-45be-bfa2-a4016c4f3afa tempest-VolumesGetTestJSON-180227003 tempest-VolumesGetTestJSON-180227003-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2" status: 404 len: 109 microversion: 2.1 time: 0.049344 Aug 22 11:11:31.149847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 464/915] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 22 11:11:31 2022] GET /compute/v2.1/os-volumes/2de89ca9-14f3-4e83-9dad-393c012b39d2 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:11:31.164478 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:31.165528 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:31.172461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:31.172956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:31.173391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:31.174355 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:31.174816 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:31.175241 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:31.423499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:31.437204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:31.439049 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:31.441357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7bc73b42-5139-4c25-9b1f-080eea32f40f tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1722 microversion: 2.20 time: 0.282043 Aug 22 11:11:31.446947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 452/916] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:31 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:11:32.468249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:32.468879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:32.477619 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:32.478357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:32.479049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:32.485645 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:32.486744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:32.490559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:32.623408 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:32.641401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:32.647086 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:32.651015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ca416200-c92e-4d05-9f5e-8a73302b3e03 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1655 microversion: 2.20 time: 0.187180 Aug 22 11:11:32.663343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 465/917] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:32 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1655 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:11:32.825473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-e5c49954-6165-411c-9a70-2722db368089 req-db439aa9-3621-4ef7-a3b7-472c771e8196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8241c043-9b2c-4e9f-bfee-5c17ee42d44b", "name": "network-vif-deleted", "tag": "515942fa-90dd-4097-b0a3-ce3fdfc6b432"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:32.842184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-e5c49954-6165-411c-9a70-2722db368089 req-db439aa9-3621-4ef7-a3b7-472c771e8196 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:32.843282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-e5c49954-6165-411c-9a70-2722db368089 req-db439aa9-3621-4ef7-a3b7-472c771e8196 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:32.848081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-e5c49954-6165-411c-9a70-2722db368089 req-db439aa9-3621-4ef7-a3b7-472c771e8196 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:32.871764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-e5c49954-6165-411c-9a70-2722db368089 req-db439aa9-3621-4ef7-a3b7-472c771e8196 service nova] Creating event network-vif-deleted:515942fa-90dd-4097-b0a3-ce3fdfc6b432 for instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b on hv-cinder-85394 Aug 22 11:11:32.875213 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-e5c49954-6165-411c-9a70-2722db368089 req-db439aa9-3621-4ef7-a3b7-472c771e8196 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054032 Aug 22 11:11:32.876530 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 453/918] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:33.677375 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:33.678176 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:33.690083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:33.695317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:33.695997 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:33.696896 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:33.697686 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:33.698351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:33.734842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:33.735582 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:33.736177 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:33.736789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lazy-loading 'fault' on Instance uuid 8241c043-9b2c-4e9f-bfee-5c17ee42d44b {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:11:33.805878 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:33.824587 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:33.831429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd13b7df898df4d238ea290fab8edc4a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629e8810bbcb4623bcd6b6aee8f7dbb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:33.836957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-28c0b104-6710-4897-9cde-ec19c3849813 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 200 len: 1371 microversion: 2.20 time: 0.160361 Aug 22 11:11:33.838646 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 466/919] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:33 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 11:11:34.884357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:34.885081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:34.892935 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:34.893676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:34.894296 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:34.895884 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:34.896500 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:34.897887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:34.920955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] HTTP exception thrown: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Request method failure captured: Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b HTTP/1.1 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K5Qx3rx1BO89BRNw4DYHm3sCADvg0mfguiQ1UktfBM3zMWlibYZpBpl-PKqN37xTe9fsUxRGw1tYUFt_9mLOZ_xFnR9IZD6NhWvL3a61EcJAmdCO3TGhwYp5Lpkev6CnlhSYN61qCfPWVQ2TDqlOGOGXdHLafPbCrbuWWKKk00_EY Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:34.922669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_629e8810bbcb4623bcd6b6aee8f7dbb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: d13b7df898df4d238ea290fab8edc4a7 Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:34.924081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '8241c043-9b2c-4e9f-bfee-5c17ee42d44b'} Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:34.924849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:34.926065 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:34.927222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Returning 404 to user: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:34.927222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43a69882-9ae3-4d2d-99f0-d1976723b7f2 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 404 len: 111 microversion: 2.20 time: 0.066688 Aug 22 11:11:34.933809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-31d649db-e1e4-4400-909d-19a34911bc61 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '.version_select at 0x7f3b4c724af0>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:34.946579 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 454/920] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:34 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:11:35.044762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-31d649db-e1e4-4400-909d-19a34911bc61 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966136140" status: 204 len: 0 microversion: 2.20 time: 0.114460 Aug 22 11:11:35.045853 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 467/921] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Aug 22 11:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966136140 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 11:11:37.533292 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:37.535223 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:37.543378 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:37.546059 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:37.547074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:37.547771 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:37.549797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:37.550581 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:37.551378 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:37.570615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] HTTP exception thrown: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Request method failure captured: Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b HTTP/1.1 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K5Qx3rx1BO89BRNw4DYHm3sCADvg0mfguiQ1UktfBM3zMWlibYZpBpl-PKqN37xTe9fsUxRGw1tYUFt_9mLOZ_xFnR9IZD6NhWvL3a61EcJAmdCO3TGhwYp5Lpkev6CnlhSYN61qCfPWVQ2TDqlOGOGXdHLafPbCrbuWWKKk00_EY Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:37.572923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_629e8810bbcb4623bcd6b6aee8f7dbb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: d13b7df898df4d238ea290fab8edc4a7 Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.574677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '8241c043-9b2c-4e9f-bfee-5c17ee42d44b'} Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:37.575775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.578177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.581466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Returning 404 to user: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:37.582800 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-41421da3-10ee-4f19-af4f-8899d5ba15a3 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 404 len: 111 microversion: 2.20 time: 0.052979 Aug 22 11:11:37.588794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 455/922] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 22 11:11:37 2022] DELETE /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:11:37.595156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:37.595946 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 8241c043-9b2c-4e9f-bfee-5c17ee42d44b] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:37.598379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:37.612754 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:37.613735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:37.614390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:37.618424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:37.618424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:37.618424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:37.638863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] HTTP exception thrown: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Request method failure captured: Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b HTTP/1.1 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K5Qx3rx1BO89BRNw4DYHm3sCADvg0mfguiQ1UktfBM3zMWlibYZpBpl-PKqN37xTe9fsUxRGw1tYUFt_9mLOZ_xFnR9IZD6NhWvL3a61EcJAmdCO3TGhwYp5Lpkev6CnlhSYN61qCfPWVQ2TDqlOGOGXdHLafPbCrbuWWKKk00_EY Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:37.640574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_629e8810bbcb4623bcd6b6aee8f7dbb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: d13b7df898df4d238ea290fab8edc4a7 Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.642343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '8241c043-9b2c-4e9f-bfee-5c17ee42d44b'} Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:37.648051 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. Aug 22 11:11:37.649601 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:37.651125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Returning 404 to user: Instance 8241c043-9b2c-4e9f-bfee-5c17ee42d44b could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:37.651125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bccbd157-4463-4e0d-85fc-0fa310064d9c tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b" status: 404 len: 111 microversion: 2.20 time: 0.054545 Aug 22 11:11:37.651125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 468/923] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:37 2022] GET /compute/v2.1/servers/8241c043-9b2c-4e9f-bfee-5c17ee42d44b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:11:38.972172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:38.980672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:38.987656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:38.988976 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:38.989428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:38.990190 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:38.990616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:38.991919 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:39.012435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] HTTP exception thrown: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Request method failure captured: Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 HTTP/1.1 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2K5Qx3rx1BO89BRNw4DYHm3sCADvg0mfguiQ1UktfBM3zMWlibYZpBpl-PKqN37xTe9fsUxRGw1tYUFt_9mLOZ_xFnR9IZD6NhWvL3a61EcJAmdCO3TGhwYp5Lpkev6CnlhSYN61qCfPWVQ2TDqlOGOGXdHLafPbCrbuWWKKk00_EY Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:11:39.015352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_629e8810bbcb4623bcd6b6aee8f7dbb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: d13b7df898df4d238ea290fab8edc4a7 Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.016811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '7473dbdb-b8d3-4481-86b9-75fd3e260bc1'} Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:39.017553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.018823 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.020088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Returning 404 to user: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:39.020088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-380677be-f41b-4e33-ba50-7defc5fadc84 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 404 len: 111 microversion: 2.20 time: 0.048047 Aug 22 11:11:39.020088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 456/924] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 22 11:11:38 2022] DELETE /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:11:39.028961 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:39.029556 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] [instance: 7473dbdb-b8d3-4481-86b9-75fd3e260bc1] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:39.037612 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:39.039343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:39.039940 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:39.040670 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:39.041132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:39.041607 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:39.072301 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] HTTP exception thrown: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Request method failure captured: Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 HTTP/1.1 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2K5Qx3rx1BO89BRNw4DYHm3sCADvg0mfguiQ1UktfBM3zMWlibYZpBpl-PKqN37xTe9fsUxRGw1tYUFt_9mLOZ_xFnR9IZD6NhWvL3a61EcJAmdCO3TGhwYp5Lpkev6CnlhSYN61qCfPWVQ2TDqlOGOGXdHLafPbCrbuWWKKk00_EY Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:11:39.083127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_629e8810bbcb4623bcd6b6aee8f7dbb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/629e8810bbcb4623bcd6b6aee8f7dbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 629e8810bbcb4623bcd6b6aee8f7dbb9 Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-831275645 Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: d13b7df898df4d238ea290fab8edc4a7 Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeShelveTestJSON-831275645-project Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.085535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '7473dbdb-b8d3-4481-86b9-75fd3e260bc1'} Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:11:39.086656 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. Aug 22 11:11:39.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:11:39.098859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] Returning 404 to user: Instance 7473dbdb-b8d3-4481-86b9-75fd3e260bc1 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:11:39.098859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-46c26293-c68e-4df3-ac52-1c63f09aea09 tempest-AttachVolumeShelveTestJSON-831275645 tempest-AttachVolumeShelveTestJSON-831275645-project] 10.222.0.48 "GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1" status: 404 len: 111 microversion: 2.20 time: 0.061443 Aug 22 11:11:39.098859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 469/925] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 22 11:11:39 2022] GET /compute/v2.1/servers/7473dbdb-b8d3-4481-86b9-75fd3e260bc1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 11:11:40.301400 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-895bc760-681d-4c74-8797-306c50d3093a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Action: 'create', calling method: .version_select at 0x7f3b4c829700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1340322727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0VEaGUmaYLjLIIKh70IbAL5/zQqorpHldu5h8/xmGZ6T32ksQ9Y39QTp+RvrbzqjNhNNuj++INONQ+sCRNsQZjWZuputmerZGrlG1gDkKr8acWkgbu3DXfjf2Pt1SR2g=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:40.322256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-895bc760-681d-4c74-8797-306c50d3093a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for project 02c34172aa804fe695944f629a348c58. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:11:40.331070 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-895bc760-681d-4c74-8797-306c50d3093a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for user 9ca8c5d1971a4ec1a448f2081ceb835b and project 02c34172aa804fe695944f629a348c58. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:11:40.433999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-895bc760-681d-4c74-8797-306c50d3093a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.345118 Aug 22 11:11:40.435269 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 457/926] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:11:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:53.513870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=52 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:53.646570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-190213ab-df15-4e15-be32-3dc01bb836f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: .version_select at 0x7f3b4c684550>, body: {"keypair": {"name": "tempest-keypair-744923555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQfBsIrLE3l6gtGZUH6BYyL3IIYPgX7LiI6uHR3w6No5xzDQF68BBLqY8f1+JH+WoJ2fOrhEhRmLUNe6Id/fTgloQPlz/yrSUa8hSw5u9tWJOS1EJb97xuLYW7+bXR37w=="}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:53.664577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-190213ab-df15-4e15-be32-3dc01bb836f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for project 6a293d557d674e8d97596857b8d179b3. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:11:53.668685 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-190213ab-df15-4e15-be32-3dc01bb836f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for user 2f8117e04a1d4f7aa802df3dda87606e and project 6a293d557d674e8d97596857b8d179b3. Resources: {'key_pairs'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:11:53.803739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-190213ab-df15-4e15-be32-3dc01bb836f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295326 Aug 22 11:11:53.807527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 470/927] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:11:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:11:56.370027 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=18 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:56.370983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:56.371754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:11:56.376266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1288030868", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32628a3c-4097-4727-8760-fd5c690f58fc"}], "security_groups": [{"name": "tempest-securitygroup--243499425"}], "key_name": "tempest-keypair-744923555", "user_data": "}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:11:56.815096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] validate_networks() for [('32628a3c-4097-4727-8760-fd5c690f58fc', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:11:57.360184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:11:57.360677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:11:57.361153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:11:57.361578 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:11:57.362132 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:11:57.373054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:57.373649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:57.374140 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:57.374978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:57.375586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:57.375968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:57.394709 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for project 6a293d557d674e8d97596857b8d179b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:11:57.399358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for user 2f8117e04a1d4f7aa802df3dda87606e and project 6a293d557d674e8d97596857b8d179b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:11:57.411069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:11:57.415299 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:11:57.533706 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-75761073-a914-4a78-8fef-76401c3aaf63 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.164873 Aug 22 11:11:57.541270 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 458/928] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:11:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 11:11:57.547774 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7fd13739-83fd-4297-a7ce-1d27c0103153 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:57.548395 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7fd13739-83fd-4297-a7ce-1d27c0103153 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:57.625384 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7fd13739-83fd-4297-a7ce-1d27c0103153 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:57.633249 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7fd13739-83fd-4297-a7ce-1d27c0103153 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1237 microversion: 2.1 time: 0.090753 Aug 22 11:11:57.633989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 471/929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:57 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:58.655260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e58338c-1394-434a-a6a6-516b6f36c0b0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:58.655795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0e58338c-1394-434a-a6a6-516b6f36c0b0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:58.712557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0e58338c-1394-434a-a6a6-516b6f36c0b0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:58.721650 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e58338c-1394-434a-a6a6-516b6f36c0b0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1237 microversion: 2.1 time: 0.070412 Aug 22 11:11:58.722207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 459/930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:58 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:11:59.743881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:11:59.744740 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:11:59.751847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:59.752360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:59.753247 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:59.754190 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:11:59.755138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:11:59.755744 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:11:59.831140 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:11:59.840441 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0d0b92c0-7ce8-4cc8-a38a-28c2306a2517 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1289 microversion: 2.1 time: 0.101341 Aug 22 11:11:59.841187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 472/931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:11:59 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:00.869131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:00.869788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:00.876187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:00.876670 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:00.877112 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:00.877806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:00.878284 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:00.878847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:01.078149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:01.088320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-826f64d8-d43b-4556-9fdf-9a5f51a7a4e9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.230648 Aug 22 11:12:01.102124 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 460/932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:00 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:01.526319 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1801223691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340322727", "security_groups": [{"name": "tempest-secgroup-smoke-880797226"}], "block_device_mapping_v2": [{"uuid": "0adaad31-c25b-491c-aeb5-51282a5e5853", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da84f983-c836-4e5d-af59-0093967b20f3"}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:01.667965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] validate_networks() for [('da84f983-c836-4e5d-af59-0093967b20f3', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:12:01.803264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-101f4174-4dcb-4c70-8f70-d5ffb5e70a22 req-b728ae80-57e3-4383-98f3-a2653a417944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80d1789-b4f0-4d30-b867-33cdd1f56f16", "tag": "42eaf8eb-6d88-41c7-8b15-950b9ed4ff54"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:01.818988 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-101f4174-4dcb-4c70-8f70-d5ffb5e70a22 req-b728ae80-57e3-4383-98f3-a2653a417944 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:01.822101 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-101f4174-4dcb-4c70-8f70-d5ffb5e70a22 req-b728ae80-57e3-4383-98f3-a2653a417944 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:01.822101 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-101f4174-4dcb-4c70-8f70-d5ffb5e70a22 req-b728ae80-57e3-4383-98f3-a2653a417944 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:01.833050 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-101f4174-4dcb-4c70-8f70-d5ffb5e70a22 req-b728ae80-57e3-4383-98f3-a2653a417944 service nova] Creating event network-changed:42eaf8eb-6d88-41c7-8b15-950b9ed4ff54 for instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 on hv-cinder-85394 Aug 22 11:12:01.841212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-101f4174-4dcb-4c70-8f70-d5ffb5e70a22 req-b728ae80-57e3-4383-98f3-a2653a417944 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042570 Aug 22 11:12:01.842851 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 461/933] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:12:02.087711 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:12:02.088232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:12:02.088772 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:12:02.089248 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:12:02.089728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:12:02.098331 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:02.098811 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:02.099240 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:02.100058 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:02.100516 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:02.100975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:02.110089 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:02.111021 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:02.118794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:02.122019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:02.122019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:02.122267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for project 02c34172aa804fe695944f629a348c58. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:12:02.122373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:02.122373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:02.122373 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:02.125125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for user 9ca8c5d1971a4ec1a448f2081ceb835b and project 02c34172aa804fe695944f629a348c58. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:12:02.190886 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:12:02.193046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0adaad31-c25b-491c-aeb5-51282a5e5853',volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:12:02.341098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:02.348708 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8a017b2c-e685-40ec-9354-770ae1be9a43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.243519 Aug 22 11:12:02.349488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 462/934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:02 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:02.649915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-70e43782-4f8e-4471-8be8-1610ecb5e2db tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.136126 Aug 22 11:12:02.650927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 473/935] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:12:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:12:02.662194 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-437588c9-78ab-4f67-b215-c784d066987d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:02.662828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-437588c9-78ab-4f67-b215-c784d066987d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:02.724633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-437588c9-78ab-4f67-b215-c784d066987d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:02.740324 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-437588c9-78ab-4f67-b215-c784d066987d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1095 microversion: 2.1 time: 0.082416 Aug 22 11:12:02.741352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 463/936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:02 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:03.370210 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:03.370928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:03.377149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:03.377729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:03.378251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:03.379025 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:03.379559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:03.380049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:03.557868 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:03.565675 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6c8c6d65-ac51-40a6-80cb-bab2125974f6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.199659 Aug 22 11:12:03.566318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 474/937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:03 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:03.761449 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43c171ae-357d-452a-b959-19b94f2d5246 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:03.761996 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-43c171ae-357d-452a-b959-19b94f2d5246 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:03.816073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-43c171ae-357d-452a-b959-19b94f2d5246 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:03.825396 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43c171ae-357d-452a-b959-19b94f2d5246 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1095 microversion: 2.1 time: 0.067847 Aug 22 11:12:03.826144 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 464/938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:03 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:04.587479 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:04.588139 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:04.594671 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:04.595151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:04.595580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:04.596259 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:04.596707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:04.597127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:04.728771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:04.736266 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2c3f3b84-41bb-41ba-8195-274dd95c1a34 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.152868 Aug 22 11:12:04.736817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 475/939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:04 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:04.849028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:04.849630 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:04.856892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:04.857394 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:04.857828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:04.858542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:04.858991 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:04.859409 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:04.932578 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:04.941234 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ac2caea0-152e-434b-8193-2566daf5347b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1193 microversion: 2.1 time: 0.096169 Aug 22 11:12:04.941921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 465/940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:04 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:05.756888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:05.757777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:05.763958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:05.764425 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:05.764852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:05.765533 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:05.765992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:05.766434 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:05.933019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:05.941476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-709828c9-10e1-43c7-884c-a09669739f28 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.188382 Aug 22 11:12:05.946495 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 476/941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:05 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:05.963473 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:05.964104 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:05.973524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:05.974118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:05.974701 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:05.975849 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:05.976424 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:05.977083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:06.198204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:06.207546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43fb4486-9419-487a-b111-b3c7dc7211a6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1278 microversion: 2.1 time: 0.248962 Aug 22 11:12:06.208448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 466/942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:05 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:06.898526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-fdcfede2-1476-46cd-b0bb-a8080752dabb req-d0d164e0-404c-4b6e-bb23-1b847db75dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89384f88-a64f-4bb4-aac9-daba0fd449c6", "tag": "7b5540c0-30f7-40ce-bd64-62e06fb27f66"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:06.908270 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-fdcfede2-1476-46cd-b0bb-a8080752dabb req-d0d164e0-404c-4b6e-bb23-1b847db75dd3 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:06.908748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-fdcfede2-1476-46cd-b0bb-a8080752dabb req-d0d164e0-404c-4b6e-bb23-1b847db75dd3 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:06.909175 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-fdcfede2-1476-46cd-b0bb-a8080752dabb req-d0d164e0-404c-4b6e-bb23-1b847db75dd3 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:06.920841 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-fdcfede2-1476-46cd-b0bb-a8080752dabb req-d0d164e0-404c-4b6e-bb23-1b847db75dd3 service nova] Creating event network-changed:7b5540c0-30f7-40ce-bd64-62e06fb27f66 for instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 on hv-cinder-85394 Aug 22 11:12:06.925606 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-fdcfede2-1476-46cd-b0bb-a8080752dabb req-d0d164e0-404c-4b6e-bb23-1b847db75dd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Aug 22 11:12:06.926451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 477/943] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:12:06.969666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:06.971669 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:06.980588 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:06.981147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:06.981590 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:06.982626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:06.983093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:06.983534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:07.166524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-39bbe6af-d621-41ed-89a2-2227245cadf3 req-1a6130b8-0ce9-4ac1-9f5e-d2075c3ef3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80d1789-b4f0-4d30-b867-33cdd1f56f16", "name": "network-vif-plugged", "status": "completed", "tag": "42eaf8eb-6d88-41c7-8b15-950b9ed4ff54"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:07.182813 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-39bbe6af-d621-41ed-89a2-2227245cadf3 req-1a6130b8-0ce9-4ac1-9f5e-d2075c3ef3fc service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:07.183528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-39bbe6af-d621-41ed-89a2-2227245cadf3 req-1a6130b8-0ce9-4ac1-9f5e-d2075c3ef3fc service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:07.184138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-39bbe6af-d621-41ed-89a2-2227245cadf3 req-1a6130b8-0ce9-4ac1-9f5e-d2075c3ef3fc service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:07.202032 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-39bbe6af-d621-41ed-89a2-2227245cadf3 req-1a6130b8-0ce9-4ac1-9f5e-d2075c3ef3fc service nova] Creating event network-vif-plugged:42eaf8eb-6d88-41c7-8b15-950b9ed4ff54 for instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 on hv-cinder-85394 Aug 22 11:12:07.207161 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-39bbe6af-d621-41ed-89a2-2227245cadf3 req-1a6130b8-0ce9-4ac1-9f5e-d2075c3ef3fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045759 Aug 22 11:12:07.207847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 478/944] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:12:07.234515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:07.237358 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:07.242078 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:07.242660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:07.243104 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:07.243813 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:07.244269 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:07.244693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:07.307069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:07.316555 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4a36c60b-3a2e-4a61-a464-7ba193826b56 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.351196 Aug 22 11:12:07.317878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 467/945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:06 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:07.399986 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:07.409086 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c3c341b7-0389-4987-8770-41cf3c114da8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.179357 Aug 22 11:12:07.421006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 479/946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:07 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:08.336016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:08.340600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:08.341248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:08.347094 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:08.347737 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:08.348186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:08.348880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:08.349334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:08.349761 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:08.431221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:08.432040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:08.440615 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:08.441108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:08.441551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:08.442327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:08.442777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:08.443200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:08.501712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:08.510755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1c5c021e-04fb-4c73-953d-427676f43806 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1362 microversion: 2.1 time: 0.175680 Aug 22 11:12:08.511336 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 468/947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:08 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:08.588895 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:08.596696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8e85e6dd-a883-49af-882e-c33825aa659f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.170091 Aug 22 11:12:08.598291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 480/948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:08 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:09.531508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:09.532116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:09.538465 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:09.538954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:09.539384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:09.540073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:09.540522 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:09.540943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:09.617681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:09.618908 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:09.626110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:09.627021 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:09.627463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:09.628233 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:09.628757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:09.629344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:09.672920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:09.681498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-33ac42d2-fe6c-4227-9a78-992d8824f53b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1548 microversion: 2.1 time: 0.153771 Aug 22 11:12:09.682080 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 469/949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:09 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:09.703209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:09.703710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:09.709861 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:09.710452 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:09.710895 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:09.711593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:09.712045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:09.712494 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:09.771989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:09.780925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d322d28c-1466-4384-bfb1-91f955ffa03e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.167741 Aug 22 11:12:09.781881 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 481/950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:09 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:09.790092 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e61157a6-3555-473b-9577-605d7c1a54c1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091216 Aug 22 11:12:09.790770 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 470/951] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:12:09 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:12:10.801079 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:10.801771 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:10.809170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:10.809828 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:10.810302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:10.810999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:10.811450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:10.811867 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:10.953652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:10.962028 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4b85a43b-b97d-46f7-92ae-1545481514ee tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.164951 Aug 22 11:12:10.963234 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 482/952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:10 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:11.055060 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-56dc3c54-1eae-4f80-956b-f2de7b12ccbc req-72df505c-fe97-4f1c-aeeb-35706f0771db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80d1789-b4f0-4d30-b867-33cdd1f56f16", "tag": "42eaf8eb-6d88-41c7-8b15-950b9ed4ff54"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:11.064895 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-56dc3c54-1eae-4f80-956b-f2de7b12ccbc req-72df505c-fe97-4f1c-aeeb-35706f0771db service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:11.065569 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-56dc3c54-1eae-4f80-956b-f2de7b12ccbc req-72df505c-fe97-4f1c-aeeb-35706f0771db service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:11.066208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-56dc3c54-1eae-4f80-956b-f2de7b12ccbc req-72df505c-fe97-4f1c-aeeb-35706f0771db service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:11.078881 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-56dc3c54-1eae-4f80-956b-f2de7b12ccbc req-72df505c-fe97-4f1c-aeeb-35706f0771db service nova] Creating event network-changed:42eaf8eb-6d88-41c7-8b15-950b9ed4ff54 for instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 on hv-cinder-85394 Aug 22 11:12:11.090456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-56dc3c54-1eae-4f80-956b-f2de7b12ccbc req-72df505c-fe97-4f1c-aeeb-35706f0771db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034136 Aug 22 11:12:11.090456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 471/953] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:12:11.982839 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:11.983440 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:11.989639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:11.990117 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:11.990599 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:11.991378 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:11.992430 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:11.993202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:12.110333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:12.127864 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:12.134324 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=12 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:12.136906 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-421edd4c-408e-4220-aa3a-43a83051fde4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.157977 Aug 22 11:12:12.137462 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 483/954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:11 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:13.159348 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:13.160027 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:13.166378 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:13.166884 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:13.167317 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:13.167996 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:13.168444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:13.168866 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:13.299414 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:13.307698 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-37311bee-8adc-4cc7-8395-911bea377f48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.153118 Aug 22 11:12:13.308266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 472/955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:13 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:14.328836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:14.329446 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:14.336873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:14.337360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:14.337799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:14.338521 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:14.338981 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:14.339408 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:14.471114 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:14.479220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5b0ca978-878f-4485-9321-bb2b11d94c34 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.154272 Aug 22 11:12:14.479784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 484/956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:14 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:15.500137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:15.500776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:15.502662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=12 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:15.508962 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:15.509439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:15.509878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:15.510585 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:15.511032 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:15.511450 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:15.644930 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:15.652995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d3b7542-7dcb-4296-8e30-c7446d2771f5 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.156832 Aug 22 11:12:15.653572 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 473/957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:15 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:16.672952 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:16.673340 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:16.679586 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:16.680061 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:16.680486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:16.681225 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:16.681641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:16.682251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:16.819096 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:16.828100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-95c09f9e-e49b-4ab4-842a-4760a100547a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.159147 Aug 22 11:12:16.828683 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 485/958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:16 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:17.849150 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:17.849811 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:17.857061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:17.857543 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:17.857977 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:17.858693 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:17.859147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:17.859575 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:17.992951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:18.000507 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-89db8833-e1e7-439d-802d-58f1bb03223f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.155189 Aug 22 11:12:18.001073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 474/959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:17 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:19.021150 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:19.021760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:19.028957 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:19.029444 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:19.029877 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:19.030693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:19.031142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:19.031733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:19.169416 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:19.177558 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2cc0f904-5621-4f47-affc-35b6e85b2e3c tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.160229 Aug 22 11:12:19.178145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 486/960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:19 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:12:19.378181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-3028482f-4cb8-4f34-a11c-f92a2547fa13 req-579bea90-3f06-4aac-bde1-ec85c4abbabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89384f88-a64f-4bb4-aac9-daba0fd449c6", "name": "network-vif-plugged", "status": "completed", "tag": "7b5540c0-30f7-40ce-bd64-62e06fb27f66"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:19.388073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3028482f-4cb8-4f34-a11c-f92a2547fa13 req-579bea90-3f06-4aac-bde1-ec85c4abbabb service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:19.388639 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3028482f-4cb8-4f34-a11c-f92a2547fa13 req-579bea90-3f06-4aac-bde1-ec85c4abbabb service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:19.389066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3028482f-4cb8-4f34-a11c-f92a2547fa13 req-579bea90-3f06-4aac-bde1-ec85c4abbabb service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:19.399646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-3028482f-4cb8-4f34-a11c-f92a2547fa13 req-579bea90-3f06-4aac-bde1-ec85c4abbabb service nova] Creating event network-vif-plugged:7b5540c0-30f7-40ce-bd64-62e06fb27f66 for instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 on hv-cinder-85394 Aug 22 11:12:19.405154 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-3028482f-4cb8-4f34-a11c-f92a2547fa13 req-579bea90-3f06-4aac-bde1-ec85c4abbabb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Aug 22 11:12:19.405960 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 475/961] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:12:20.199686 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:20.200293 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:20.207390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:20.207915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:20.208357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:20.209072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:20.209685 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:20.210164 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:20.354435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:20.362345 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-68dd612c-d1ed-42f1-81ca-517291181322 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.167825 Aug 22 11:12:20.362914 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 487/962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:20 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:21.383935 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:21.384642 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:21.391626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:21.397118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:21.397118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:21.397118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:21.397118 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:21.397471 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:21.537677 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:21.546918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-76150f61-76c9-44cb-ab5c-d7b89fa8fea8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1266 microversion: 2.1 time: 0.167643 Aug 22 11:12:21.547694 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 476/963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:21 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:22.567450 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:22.568062 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:22.575367 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:22.575854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:22.576283 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:22.576985 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:22.577436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:22.577857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:22.709259 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:22.718542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-783b24ea-f637-4e7a-8e84-1f9adfa62884 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1454 microversion: 2.1 time: 0.154696 Aug 22 11:12:22.719127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 488/964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:22 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:22.738451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:22.739097 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:22.747761 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:22.748248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:22.748714 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:22.749433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:22.749901 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:22.750378 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:22.892458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:12:22.900500 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-18026ed1-9bbf-4c72-b1c9-7600e470da04 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1454 microversion: 2.1 time: 0.165896 Aug 22 11:12:22.901146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 477/965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:12:22 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:12:24.981537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-f50ef597-1e21-4ffd-8e88-00029170f85d req-feaefa17-534c-40f8-a9d5-8c6339a6a128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89384f88-a64f-4bb4-aac9-daba0fd449c6", "tag": "7b5540c0-30f7-40ce-bd64-62e06fb27f66"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:24.988026 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:24.993496 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-f50ef597-1e21-4ffd-8e88-00029170f85d req-feaefa17-534c-40f8-a9d5-8c6339a6a128 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:24.993965 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-f50ef597-1e21-4ffd-8e88-00029170f85d req-feaefa17-534c-40f8-a9d5-8c6339a6a128 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:24.994600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-f50ef597-1e21-4ffd-8e88-00029170f85d req-feaefa17-534c-40f8-a9d5-8c6339a6a128 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:24.999217 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=91 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:25.006661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-f50ef597-1e21-4ffd-8e88-00029170f85d req-feaefa17-534c-40f8-a9d5-8c6339a6a128 service nova] Creating event network-changed:7b5540c0-30f7-40ce-bd64-62e06fb27f66 for instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 on hv-cinder-85394 Aug 22 11:12:25.012208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-f50ef597-1e21-4ffd-8e88-00029170f85d req-feaefa17-534c-40f8-a9d5-8c6339a6a128 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034956 Aug 22 11:12:25.012984 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 489/966] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:12:54.389134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:12:54.389675 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:54.391880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:54.392556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=84 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:12:54.397492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:54.398021 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:54.398488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:54.404086 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:54.404086 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:54.404086 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:54.423039 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c5f56a3e-e9bb-4a78-a9b7-d5dc0f11e83b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/ips" status: 200 len: 145 microversion: 2.1 time: 0.037754 Aug 22 11:12:54.423606 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 478/967] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:12:54 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:12:56.896160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee6501bb-e62b-4ede-b1be-d49f94c011d9"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:12:56.898669 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:12:56.906784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:56.907267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:56.907755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:56.908436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:12:56.908921 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:12:56.909341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:12:57.627568 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-aad45d01-f1b9-4d8b-9714-bf85a70b3307 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737270 Aug 22 11:12:57.628248 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 490/968] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:12:56 2022] POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:13:05.140110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd270405-a1f7-4a3b-91f4-701b4d092559 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:13:05.148219 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd270405-a1f7-4a3b-91f4-701b4d092559 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:05.148696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd270405-a1f7-4a3b-91f4-701b4d092559 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:05.149131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd270405-a1f7-4a3b-91f4-701b4d092559 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:05.210093 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd270405-a1f7-4a3b-91f4-701b4d092559 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Going to try to stop instance {{(pid=121142) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 11:13:05.363956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd270405-a1f7-4a3b-91f4-701b4d092559 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action" status: 202 len: 0 microversion: 2.1 time: 0.227118 Aug 22 11:13:05.369384 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 479/969] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:13:05 2022] POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:13:05.373934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:05.374789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:05.381593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:05.382074 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:05.382535 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:05.383226 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:05.383677 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:05.384096 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:05.520241 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:05.531203 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fad3d450-8d55-4cc2-9f14-c2915f4c08c5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.161670 Aug 22 11:13:05.531790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 491/970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:05 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:13:06.554347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:06.554967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:06.561521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:06.561999 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:06.562466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:06.563152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:06.563604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:06.564025 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:06.689432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:06.698220 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51bf8e86-2a67-4f54-978d-d8a25e76991f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.149174 Aug 22 11:13:06.698802 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 480/971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:06 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:07.719994 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:07.720616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:07.727142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:07.727627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:07.728066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:07.728765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:07.729221 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:07.729644 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:07.860376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:07.871191 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c1ce2373-5bc6-4daf-bd7d-ebb5d7998220 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.154921 Aug 22 11:13:07.871941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 492/972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:07 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:08.896796 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:08.897429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:08.903679 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:08.904445 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:08.904897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:08.905582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:08.906030 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:08.906472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:09.295765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:09.304076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8de87b8e-6330-4f1f-90f1-d4c2cf88006d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.411812 Aug 22 11:13:09.305045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 481/973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:08 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:10.325306 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:10.325920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:10.333088 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:10.333570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:10.334007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:10.334739 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:10.335192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:10.335616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:10.462480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:10.470575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fcfab4ce-b103-4cbb-b8fe-e7da855b5077 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.149044 Aug 22 11:13:10.471143 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 493/974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:10 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:11.491510 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:11.492141 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:11.499014 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:11.499488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:11.499920 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:11.500596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:11.501044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:11.501464 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:11.631133 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:11.640286 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-531bb319-b070-4246-9109-52a9e6bbcd9b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.152678 Aug 22 11:13:11.640899 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 482/975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:11 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:12.662083 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:12.662638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:12.669187 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:12.669663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:12.670124 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:12.670846 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:12.671276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:12.671691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:12.797247 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:12.805390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-408dd242-88b1-41c7-a6b1-4c951477ec22 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.147184 Aug 22 11:13:12.805954 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 494/976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:12 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:13.827112 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:13.827780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:13.834110 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:13.834625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:13.835069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:13.835754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:13.836202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:13.836625 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:13.969063 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:13.977289 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0af15da0-98d8-4799-b27b-eafceaaed041 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.154069 Aug 22 11:13:13.977845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 483/977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:13 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:14.999832 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:15.000431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:15.006813 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:15.007291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:15.007727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:15.008418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:15.008870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:15.009291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:15.140797 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:15.148813 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c7416408-a6ad-4d1e-9f5e-b0beeb3ce8f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.153895 Aug 22 11:13:15.149368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 495/978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:14 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:16.169838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:16.170417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:16.176875 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:16.177351 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:16.177781 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:16.178483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:16.178930 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:16.179347 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:16.305723 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:16.313810 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d6afa9a8-5b8b-4f30-91ef-d748ea6a9802 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.147997 Aug 22 11:13:16.314395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 484/979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:16 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:17.335490 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:17.336105 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:17.342742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:17.343227 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:17.343666 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:17.344352 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:17.344805 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:17.345232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:17.471592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:17.479729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-58f47240-5a3c-4063-83ad-e7c723c766a4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.148107 Aug 22 11:13:17.480451 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 496/980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:17 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:18.501073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:18.501712 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:18.508126 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:18.508603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:18.509038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:18.509731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:18.510172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:18.510621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:18.638944 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:18.647039 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9b2f61c3-fa80-4ab8-860c-dbdbfbbe0043 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.149804 Aug 22 11:13:18.647606 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 485/981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:18 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:19.668538 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:19.669148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:19.676169 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:19.676647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:19.677413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:19.678476 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:19.678934 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:19.679362 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:19.814783 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:19.822915 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d79c1cc6-6d2e-4efc-a9bc-526d8f3e0dc4 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.159002 Aug 22 11:13:19.823472 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 497/982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:19 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:20.844673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:20.845360 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:20.851758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:20.852238 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:20.852753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:20.853635 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:20.853832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:20.854374 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:20.997725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:21.005923 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d23599bf-c562-434f-ac55-3ed13f1172c9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1722 microversion: 2.1 time: 0.165806 Aug 22 11:13:21.006521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 486/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:20 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:22.028614 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:22.029211 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:22.035630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:22.036100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:22.036528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:22.037203 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:22.037648 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:22.038060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:22.167891 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:22.176019 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-16da825f-44bf-4bf9-9bd2-6952586a42eb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1699 microversion: 2.1 time: 0.151850 Aug 22 11:13:22.176575 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 498/984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:22 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:22.198545 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b46c4ab6-4bec-4ea0-b16f-5da3adbf92bf tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:13:22.205582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46c4ab6-4bec-4ea0-b16f-5da3adbf92bf tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:22.206058 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46c4ab6-4bec-4ea0-b16f-5da3adbf92bf tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:22.206530 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46c4ab6-4bec-4ea0-b16f-5da3adbf92bf tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:22.228843 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b46c4ab6-4bec-4ea0-b16f-5da3adbf92bf tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Going to try to start instance {{(pid=121142) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 11:13:22.410554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b46c4ab6-4bec-4ea0-b16f-5da3adbf92bf tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action" status: 202 len: 0 microversion: 2.1 time: 0.215693 Aug 22 11:13:22.411260 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 487/985] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:13:22 2022] POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:13:22.419384 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:22.419999 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:22.426029 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:22.426555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:22.427002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:22.427821 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:22.428279 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:22.428708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:22.559936 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:22.568156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9d612f42-3e98-485d-b20e-4d6b8b764fa0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1708 microversion: 2.1 time: 0.152735 Aug 22 11:13:22.568725 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 499/986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:22 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:23.591912 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:23.592610 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:23.598680 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:23.599158 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:23.599590 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:23.600277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:23.600725 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:23.601149 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:23.736331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:23.744646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-66be3334-2b25-4f26-a304-93a9a3a823f9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1708 microversion: 2.1 time: 0.158105 Aug 22 11:13:23.745210 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 488/987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:23 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:24.766013 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:24.766690 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:24.773752 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:24.774254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:24.774718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:24.775415 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:24.775860 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:24.776281 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:24.907748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:13:24.916623 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5fe692cd-0576-451e-9f29-a8b8fa7f1018 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1712 microversion: 2.1 time: 0.155459 Aug 22 11:13:24.917202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 500/988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:24 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:13:58.253826 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:58.254483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:58.256619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=22 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:13:58.257277 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:13:58.261833 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:58.262488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:58.262979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:58.263600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:58.264044 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:58.264459 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:58.345727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lazy-loading 'services' on Instance uuid c80d1789-b4f0-4d30-b867-33cdd1f56f16 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:13:58.560820 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-20ee69fe-749a-4c06-abe1-5f706506001e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-volume_attachments/ee6501bb-e62b-4ede-b1be-d49f94c011d9" status: 202 len: 0 microversion: 2.1 time: 0.310935 Aug 22 11:13:58.561334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 489/989] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:13:58 2022] DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-volume_attachments/ee6501bb-e62b-4ede-b1be-d49f94c011d9 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:13:59.679750 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-01176193-0c0c-41c1-857c-48fd02417be1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:13:59.682131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=23 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:13:59.682817 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:13:59.688179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01176193-0c0c-41c1-857c-48fd02417be1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:59.688662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01176193-0c0c-41c1-857c-48fd02417be1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:59.689096 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-01176193-0c0c-41c1-857c-48fd02417be1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:59.747037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-01176193-0c0c-41c1-857c-48fd02417be1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Going to try to stop instance {{(pid=121143) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 11:13:59.913631 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-01176193-0c0c-41c1-857c-48fd02417be1 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action" status: 202 len: 0 microversion: 2.1 time: 0.237572 Aug 22 11:13:59.914332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 501/990] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:13:59 2022] POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:13:59.924329 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:13:59.925195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:13:59.931535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:59.932017 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:59.932447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:13:59.933138 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:13:59.933589 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:13:59.934081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:00.066189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:00.073754 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f23b7b4a-9833-488f-9f2d-591cf6cc2df9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.154959 Aug 22 11:14:00.074339 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 490/991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:13:59 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:01.095648 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:01.096333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:01.103044 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:01.103537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:01.103966 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:01.104659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:01.105107 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:01.105528 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:01.232605 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:01.240734 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-50311af9-996a-451b-8454-1d7504afaba3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.150277 Aug 22 11:14:01.241281 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 502/992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:01 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:02.262673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:02.263281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:02.270385 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:02.270757 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:02.271192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:02.271887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:02.272340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:02.272764 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:02.402461 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:02.410382 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8345bc8c-018b-4a48-84ba-77be8b90dc8e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.151685 Aug 22 11:14:02.410951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 491/993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:02 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:03.432089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:03.432790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:03.439236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:03.439762 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:03.440197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:03.440879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:03.441326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:03.441746 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:03.586354 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:03.594775 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b6527bf3-6f77-4480-beb6-d9f6910f2b99 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.166568 Aug 22 11:14:03.595336 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 503/994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:03 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:04.615410 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:04.615927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:04.622562 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:04.623042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:04.623478 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:04.624192 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:04.624731 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:04.625159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:04.753578 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:04.761189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4d52d48b-8e3d-48a1-b266-e0290564c01b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.149672 Aug 22 11:14:04.761755 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 492/995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:04 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:05.783147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:05.783830 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:05.790102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:05.790616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:05.791042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:05.791720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:05.792162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:05.792580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:05.919701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:05.927545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-be61f0e4-b3d4-41d4-becd-d703cd388cc9 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.148921 Aug 22 11:14:05.928110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 504/996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:05 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:06.949025 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:06.949638 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:06.956807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:06.957283 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:06.957719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:06.958429 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:06.958882 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:06.959301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:07.092414 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:07.100261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a2dba0fc-76ac-4e05-9bac-0bf2e4310047 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.155117 Aug 22 11:14:07.100821 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 493/997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:06 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:08.122677 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:08.123227 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:08.130049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:08.130559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:08.130992 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:08.131677 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:08.132130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:08.132552 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:08.262033 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:08.270363 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-70e0d1c8-191d-40b3-8c12-ae22233640a0 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.151983 Aug 22 11:14:08.270926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 505/998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:08 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:09.291946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:09.292519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:09.301711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:09.301711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:09.301711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:09.301711 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:09.302171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:09.302171 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:09.440596 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:09.448178 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-31bceddf-f060-42d0-a783-46f06ecb3d04 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1676 microversion: 2.1 time: 0.160427 Aug 22 11:14:09.448736 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 494/999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:09 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:10.469617 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:10.470304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:10.476822 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:10.477304 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:10.477804 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:10.478519 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:10.478975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:10.479395 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:10.609337 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:10.616877 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-efb90f72-dad3-4c49-83cf-57742ad77686 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1653 microversion: 2.1 time: 0.151722 Aug 22 11:14:10.617436 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 506/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:10 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:10.637594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-838a1931-e31f-483a-8724-a1e03cbd0e83 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:10.644108 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-838a1931-e31f-483a-8724-a1e03cbd0e83 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:10.644576 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-838a1931-e31f-483a-8724-a1e03cbd0e83 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:10.645003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-838a1931-e31f-483a-8724-a1e03cbd0e83 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:10.669430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-838a1931-e31f-483a-8724-a1e03cbd0e83 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Going to try to start instance {{(pid=121142) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 11:14:10.804364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-838a1931-e31f-483a-8724-a1e03cbd0e83 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action" status: 202 len: 0 microversion: 2.1 time: 0.170439 Aug 22 11:14:10.805045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 495/1001] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 22 11:14:10 2022] POST /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:14:10.817749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:10.818306 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:10.824379 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:10.824855 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:10.825485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:10.826177 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:10.826662 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:10.827610 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:10.958470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:10.966251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-118c00c1-e02c-4fad-bfc5-ea6b58318ca5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1662 microversion: 2.1 time: 0.152282 Aug 22 11:14:10.966879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 507/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:10 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:11.988488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:11.989326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:11.995707 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:11.996187 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:11.996622 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:11.997309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:11.997757 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:11.998177 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:12.125574 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:12.133188 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d9841d86-f178-4e66-8d0e-a86aebbd9170 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1662 microversion: 2.1 time: 0.149414 Aug 22 11:14:12.133753 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 496/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:11 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:13.155145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:13.155693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:13.162311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:13.162798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:13.163229 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:13.163926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:13.164376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:13.164798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:13.293351 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:13.301865 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c0ced9ea-cbab-4356-bab2-68c186c2f20e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1666 microversion: 2.1 time: 0.150726 Aug 22 11:14:13.302459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 508/1004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:13 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:27.289076 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:14:27.289686 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Mon Aug 22 11:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:14:28.804592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:14:28.805151 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Mon Aug 22 11:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:14:29.447741 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:14:29.447910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Mon Aug 22 11:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:14:30.102390 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:30.102916 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:30.105300 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=16 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:30.105955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:30.110652 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:30.111131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:30.111570 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:30.112256 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:30.112776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:30.113130 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:30.138460 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:14:30.401582 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a9748627-ede9-4ae3-ae29-40fcca79eb48 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 204 len: 0 microversion: 2.1 time: 0.302847 Aug 22 11:14:30.402085 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 497/1005] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:14:30 2022] DELETE /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:14:30.410433 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:30.411048 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:30.413130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=16 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:30.413809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:30.419011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:30.419493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:30.419925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:30.420611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:30.421064 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:30.421485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:30.730481 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:30.738129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5de82122-1a2a-4ad9-b491-eb63faf7d11a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1579 microversion: 2.1 time: 0.331900 Aug 22 11:14:30.738708 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 509/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:30 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1579 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:31.143748 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:14:31.144326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Mon Aug 22 11:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:14:31.759673 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:31.760364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:31.766911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:31.767419 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:31.767855 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:31.768564 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:31.769106 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:31.769540 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:31.964315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:31.972151 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b3d21b26-8b96-470e-a629-e9ba81a4c583 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1579 microversion: 2.1 time: 0.216825 Aug 22 11:14:31.972705 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 498/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:31 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1579 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:32.993551 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:32.994129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:33.002597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:33.003084 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:33.003515 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:33.004399 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:33.004713 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:33.005134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:33.014048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-f812087d-7134-43d1-89d7-df462f7ee8c1 req-4fe14a21-27dd-42f9-bda5-ff743d90479b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89384f88-a64f-4bb4-aac9-daba0fd449c6", "name": "network-vif-deleted", "tag": "7b5540c0-30f7-40ce-bd64-62e06fb27f66"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:33.024496 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-f812087d-7134-43d1-89d7-df462f7ee8c1 req-4fe14a21-27dd-42f9-bda5-ff743d90479b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:33.024967 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-f812087d-7134-43d1-89d7-df462f7ee8c1 req-4fe14a21-27dd-42f9-bda5-ff743d90479b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:33.025391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-f812087d-7134-43d1-89d7-df462f7ee8c1 req-4fe14a21-27dd-42f9-bda5-ff743d90479b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:33.038961 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-f812087d-7134-43d1-89d7-df462f7ee8c1 req-4fe14a21-27dd-42f9-bda5-ff743d90479b service nova] Creating event network-vif-deleted:7b5540c0-30f7-40ce-bd64-62e06fb27f66 for instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 on hv-cinder-85394 Aug 22 11:14:33.044216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-f812087d-7134-43d1-89d7-df462f7ee8c1 req-4fe14a21-27dd-42f9-bda5-ff743d90479b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Aug 22 11:14:33.047964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 499/1008] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:14:33.091532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:33.100045 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-70a93378-66e4-49cf-94a8-88ad2a57b22d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1512 microversion: 2.1 time: 0.110917 Aug 22 11:14:33.100625 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 510/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:32 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1512 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:34.128653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:34.129247 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:34.135488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:34.135979 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:34.136417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:34.137109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:34.137566 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:34.137993 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:34.171886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:34.172383 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:34.172815 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:34.173262 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lazy-loading 'fault' on Instance uuid 89384f88-a64f-4bb4-aac9-daba0fd449c6 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:14:34.220546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:34.226691 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-962d55b8-d9ba-4558-ae25-485dbc784984 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 200 len: 1185 microversion: 2.1 time: 0.103039 Aug 22 11:14:34.227261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 500/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:34 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 1185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:35.248148 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:35.248732 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:35.255222 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:35.255701 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:35.256131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:35.256803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:35.257246 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:35.257660 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:35.271171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] HTTP exception thrown: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Request method failure captured: Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 HTTP/1.1 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2Rkl5N7lIkmP564dTKtuw3SbjMJOhqE6fAIjOusT8eBB4dYVAHUP3_Ds47W9gPHtYB1eBwzeecYa6oE7E3JsIk36Zd3oBGn4CS_1KE-btH4pM9W-bLaY06hfKS-6yyCj3mKr5kHrbvGnU2nyYKPAmVfOjfELeTyUg1RTVHnDCdsL04 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:14:35.272768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02c34172aa804fe695944f629a348c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02c34172aa804fe695944f629a348c58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-TestVolumeBootPattern-534572824 Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 9ca8c5d1971a4ec1a448f2081ceb835b Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:14:35.274596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '89384f88-a64f-4bb4-aac9-daba0fd449c6'} Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:14:35.275592 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:14:35.277197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:35.278651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Returning 404 to user: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:14:35.278651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-87446b14-0d93-4103-beb9-4336e64deddb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 404 len: 111 microversion: 2.1 time: 0.030080 Aug 22 11:14:35.278651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 511/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:35 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:14:35.369477 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2073675032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340322727", "security_groups": [{"name": "tempest-secgroup-smoke-880797226"}], "block_device_mapping_v2": [{"uuid": "0adaad31-c25b-491c-aeb5-51282a5e5853", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da84f983-c836-4e5d-af59-0093967b20f3"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:35.485571 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] validate_networks() for [('da84f983-c836-4e5d-af59-0093967b20f3', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:14:35.855926 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:14:35.856350 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:14:35.856821 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:14:35.857227 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:14:35.857634 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:14:35.866832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:35.867309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:35.867734 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:35.868444 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:35.868889 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:35.869355 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:35.885799 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for project 02c34172aa804fe695944f629a348c58. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:14:35.889643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for user 9ca8c5d1971a4ec1a448f2081ceb835b and project 02c34172aa804fe695944f629a348c58. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:14:35.946483 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:14:35.948592 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0adaad31-c25b-491c-aeb5-51282a5e5853',volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:14:36.352758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fd1a1bb3-87f2-44c0-b446-f966e4059f2b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.987029 Aug 22 11:14:36.353523 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 501/1012] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:14:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:14:36.365132 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4c8661fb-79a0-42d8-ae98-5e26ab1577f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:36.365740 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4c8661fb-79a0-42d8-ae98-5e26ab1577f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:36.422613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4c8661fb-79a0-42d8-ae98-5e26ab1577f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:36.429376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4c8661fb-79a0-42d8-ae98-5e26ab1577f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1095 microversion: 2.1 time: 0.068124 Aug 22 11:14:36.429931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 512/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:36 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:37.453354 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:37.454018 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:37.460285 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:37.460766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:37.461200 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:37.461893 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:37.462400 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:37.462818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:37.525888 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:37.533884 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-15cb83e4-7fd2-4cb1-968b-9edf09f8a4c2 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1145 microversion: 2.1 time: 0.085682 Aug 22 11:14:37.534487 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 502/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:37 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:38.554095 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:38.554731 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:38.562199 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:38.562453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:38.562945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:38.563830 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:38.564287 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:38.564709 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:38.627204 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:38.636196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a2a3f6de-89ab-48fb-b4cc-23f1d70fa653 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1211 microversion: 2.1 time: 0.085508 Aug 22 11:14:38.636647 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 513/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:38 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:39.658311 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:39.658951 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:39.665453 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:39.666079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:39.666556 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:39.667258 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:39.667703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:39.668172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:40.198318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:40.207000 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e5415beb-5a3f-4d48-b02d-f125c71b0f0e tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.553762 Aug 22 11:14:40.207559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 503/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:39 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:40.357976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-cff39ed6-4c44-4663-be7f-56125c78d468 req-ee11e769-0f12-43ec-acfb-f531862132a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d654e40-0fcf-46a6-938f-a784f1e7f736", "tag": "4065871f-1795-46ad-ae8f-c7969723a9fa"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:40.369975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-cff39ed6-4c44-4663-be7f-56125c78d468 req-ee11e769-0f12-43ec-acfb-f531862132a0 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:40.371522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-cff39ed6-4c44-4663-be7f-56125c78d468 req-ee11e769-0f12-43ec-acfb-f531862132a0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:40.371522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-cff39ed6-4c44-4663-be7f-56125c78d468 req-ee11e769-0f12-43ec-acfb-f531862132a0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:40.382824 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-cff39ed6-4c44-4663-be7f-56125c78d468 req-ee11e769-0f12-43ec-acfb-f531862132a0 service nova] Creating event network-changed:4065871f-1795-46ad-ae8f-c7969723a9fa for instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 on hv-cinder-85394 Aug 22 11:14:40.387727 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-cff39ed6-4c44-4663-be7f-56125c78d468 req-ee11e769-0f12-43ec-acfb-f531862132a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033933 Aug 22 11:14:40.388384 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 514/1017] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:14:41.228700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:41.229340 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:41.236028 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:41.236509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:41.236946 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:41.237782 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:41.238273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:41.238707 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:41.367489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:41.375498 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a2f84a0f-06da-4a3a-b0fb-bee8d702d953 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.150801 Aug 22 11:14:41.376255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 504/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:41 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:42.396181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:42.396876 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:42.403555 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:42.404037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:42.404474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:42.405162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:42.405659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:42.406254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:42.536416 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:42.543970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-3cf6bee7-17fb-4ce5-8baa-11791102074b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.151974 Aug 22 11:14:42.544526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 515/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:42 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:43.564614 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:43.565233 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:43.571678 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:43.572172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:43.572609 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:43.573304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:43.573760 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:43.574186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:43.707135 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:43.714750 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e93ca41a-32db-4b1d-9bbc-ca4c1589a137 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.154039 Aug 22 11:14:43.715301 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 505/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:43 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:44.735728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:44.736344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:44.743002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:44.743496 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:44.743939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:44.744669 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:44.745125 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:44.745816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:44.877715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:44.885370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-067ee777-b1db-46ab-a49c-5d3cad7c20c7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.153879 Aug 22 11:14:44.885933 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 516/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:44 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:45.905879 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:45.906491 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:45.909069 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:45.909860 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:45.914623 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:45.915100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:45.915598 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:45.916284 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:45.916791 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:45.917367 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.025126 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:46.027296 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:46.033562 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:46.034038 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:46.034506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.035197 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:46.035643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:46.036060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.056296 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:46.065189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-405712b0-5c0d-409c-bc37-100c349db046 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.163326 Aug 22 11:14:46.065949 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 506/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:45 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:46.067127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-1420d9d8-8aca-4301-9d0e-acefbc261aca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045850 Aug 22 11:14:46.067693 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 517/1023] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:14:46 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 11:14:46.130671 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:46.131194 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:46.137143 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:46.137626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:46.138060 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.138780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:46.139231 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:46.139656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.164117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:14:46.441003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9aa2f190-44da-4c2d-b30f-9c0b35707c4f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 204 len: 0 microversion: 2.1 time: 0.313662 Aug 22 11:14:46.441544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 507/1024] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:14:46 2022] DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:14:46.449763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:46.450500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:46.452542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:46.457393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:46.457873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:46.458347 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.459040 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:46.459522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:46.459941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:46.589861 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:46.597661 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7543e234-aaf8-4fb0-b03f-aa95b2a60afd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1672 microversion: 2.1 time: 0.151802 Aug 22 11:14:46.598219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 518/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:46 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:47.086906 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:47.087629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:47.094351 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:47.094850 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:47.095291 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:47.096003 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:47.096448 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:47.096863 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:47.241079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:47.249061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b9794d26-7eb0-42f0-a1cf-6eca089fdd67 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.166433 Aug 22 11:14:47.254559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 508/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:47 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:47.619057 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:47.619659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:47.626964 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:47.627484 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:47.627910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:47.628603 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:47.629047 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:47.629465 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:47.759873 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:47.767616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a82e6920-319f-42c6-8e92-2221bddd617b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1672 microversion: 2.1 time: 0.152452 Aug 22 11:14:47.768174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 519/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:47 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:48.269534 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:48.270147 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:48.276524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:48.277002 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:48.277436 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:48.278117 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:48.278598 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:48.279022 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:48.411886 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:48.419538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-073d9fde-5653-4159-99e5-8fc0f90f60cd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.154458 Aug 22 11:14:48.420095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 509/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:48 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:48.788788 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:48.789390 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:48.795729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:48.796206 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:48.796641 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:48.797318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:48.797763 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:48.798179 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:48.924368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:48.931894 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-94c9d8d5-e2ea-49ab-9771-c1b2bae7aca3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1672 microversion: 2.1 time: 0.146973 Aug 22 11:14:48.932458 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 520/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:48 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:49.441400 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:49.442007 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:49.448998 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:49.449489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:49.450075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:49.450653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:49.451210 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:49.451647 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:49.652495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:49.660788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4d6fb141-58fb-49b5-b396-7cd127b56fba tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.223974 Aug 22 11:14:49.661362 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 510/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:49 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:49.953543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:49.954147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:49.960580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:49.961060 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:49.961492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:49.962180 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:49.962658 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:49.963074 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:50.027174 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:50.035835 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-c1c79532-725a-47d4-ada6-5ec4f174ccc8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1605 microversion: 2.1 time: 0.086718 Aug 22 11:14:50.036404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 521/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:49 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:50.102470 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-9c67356b-545b-4f20-b84d-a372d9069611 req-1485c596-ba44-4c60-9063-469ec66616b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80d1789-b4f0-4d30-b867-33cdd1f56f16", "name": "network-vif-deleted", "tag": "42eaf8eb-6d88-41c7-8b15-950b9ed4ff54"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:50.111857 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9c67356b-545b-4f20-b84d-a372d9069611 req-1485c596-ba44-4c60-9063-469ec66616b0 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:50.113205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9c67356b-545b-4f20-b84d-a372d9069611 req-1485c596-ba44-4c60-9063-469ec66616b0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:50.113205 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9c67356b-545b-4f20-b84d-a372d9069611 req-1485c596-ba44-4c60-9063-469ec66616b0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:50.116646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:14:50.123981 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-9c67356b-545b-4f20-b84d-a372d9069611 req-1485c596-ba44-4c60-9063-469ec66616b0 service nova] Creating event network-vif-deleted:42eaf8eb-6d88-41c7-8b15-950b9ed4ff54 for instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 on hv-cinder-85394 Aug 22 11:14:50.129073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-9c67356b-545b-4f20-b84d-a372d9069611 req-1485c596-ba44-4c60-9063-469ec66616b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030236 Aug 22 11:14:50.129657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 511/1032] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:14:50.349786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-b68e61a7-f24d-4c2b-aadf-9ff60ee10de7 req-6053cc3a-664f-42cc-aa30-a23fdabd4317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d654e40-0fcf-46a6-938f-a784f1e7f736", "name": "network-vif-plugged", "status": "completed", "tag": "4065871f-1795-46ad-ae8f-c7969723a9fa"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:50.359891 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b68e61a7-f24d-4c2b-aadf-9ff60ee10de7 req-6053cc3a-664f-42cc-aa30-a23fdabd4317 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:50.360374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b68e61a7-f24d-4c2b-aadf-9ff60ee10de7 req-6053cc3a-664f-42cc-aa30-a23fdabd4317 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:50.360805 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-b68e61a7-f24d-4c2b-aadf-9ff60ee10de7 req-6053cc3a-664f-42cc-aa30-a23fdabd4317 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:50.372067 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-b68e61a7-f24d-4c2b-aadf-9ff60ee10de7 req-6053cc3a-664f-42cc-aa30-a23fdabd4317 service nova] Creating event network-vif-plugged:4065871f-1795-46ad-ae8f-c7969723a9fa for instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 on hv-cinder-85394 Aug 22 11:14:50.377455 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-b68e61a7-f24d-4c2b-aadf-9ff60ee10de7 req-6053cc3a-664f-42cc-aa30-a23fdabd4317 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 Aug 22 11:14:50.382214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 522/1033] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:14:50.682499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:50.683194 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:50.689880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:50.690432 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:50.690871 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:50.691563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:50.692034 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:50.692456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:50.878258 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:50.892504 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff01a20f-9819-4463-8c5b-8552a38efeb6 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.214976 Aug 22 11:14:50.904369 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 512/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:50 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:51.066255 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:51.066945 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:51.073784 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:51.074286 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:51.074717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:51.075419 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:51.076322 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:51.076322 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:51.110877 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:51.111360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:51.111786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:51.112220 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lazy-loading 'fault' on Instance uuid c80d1789-b4f0-4d30-b867-33cdd1f56f16 {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:14:51.165632 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:51.173776 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-b16e77ad-e526-4344-a156-e6abd927cd62 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 200 len: 1327 microversion: 2.1 time: 0.119627 Aug 22 11:14:51.174638 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 523/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:51 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:51.914557 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:51.915173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:51.922370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:51.922856 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:51.923294 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:51.923983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:51.924438 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:51.924864 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:52.053903 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:52.062208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aac0b208-fcf5-4ee2-bd1b-1e598cab2e1f tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1266 microversion: 2.1 time: 0.150944 Aug 22 11:14:52.062775 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 513/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:51 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:52.195356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:52.195911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:52.202504 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:52.203253 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:52.204006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:52.204991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:52.205449 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:52.205872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:52.220106 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] HTTP exception thrown: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Request method failure captured: Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 HTTP/1.1 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2R5MVDyu_aq2PhxCfKnsHG0PzO3k7gn8ISw0WXHVYvB6IHxBP_fmNg8x53x2l1IIzX3XBUX4lmeT92ClNl3FqcTArH93KZZtk_4fd3j3yk9WE7XA5L8n-GFkqDROzQb7lOr1Sh2S8jEh8mrnvXVgK0-gAXWOnF5pxhNxBevJNvzy-4 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:14:52.221757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a293d557d674e8d97596857b8d179b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 2f8117e04a1d4f7aa802df3dda87606e Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:14:52.223429 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'c80d1789-b4f0-4d30-b867-33cdd1f56f16'} Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:14:52.224312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:14:52.225593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:14:52.226749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Returning 404 to user: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:14:52.226749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fe3f2a43-4dee-4cbf-a8bf-4c3a1243bdcb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 404 len: 111 microversion: 2.1 time: 0.031946 Aug 22 11:14:52.226749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 524/1037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:52 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:14:52.232165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-19e5b3ab-beab-4b6f-9419-ca0d0d9869f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '.version_select at 0x7f3b4c7fe280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:52.321031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-19e5b3ab-beab-4b6f-9419-ca0d0d9869f5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744923555" status: 202 len: 0 microversion: 2.1 time: 0.092688 Aug 22 11:14:52.321608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 514/1038] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 22 11:14:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744923555 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 11:14:53.082958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:53.083486 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:53.089427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:53.089916 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:53.090394 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:53.091101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:53.091577 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:53.092011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:53.122995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f86a253c-1835-4168-8947-f6c877a14a88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: .version_select at 0x7f3b4c984ee0>, body: {"keypair": {"name": "tempest-keypair-1940977656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNE2sZeNufHcTsflBmo2i2ETN4mVO+V9uMd//vmkzoa1zTT3L9FbdxwP+PmWGpZGQufgUeTmLlRv4EmVUBORwTPghtKm1YKnBK95zwu3UcZ0blElCiy6guOaokktiJRqhw=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:53.138603 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-f86a253c-1835-4168-8947-f6c877a14a88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for project 6a293d557d674e8d97596857b8d179b3. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:14:53.142538 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-f86a253c-1835-4168-8947-f6c877a14a88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for user 2f8117e04a1d4f7aa802df3dda87606e and project 6a293d557d674e8d97596857b8d179b3. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:14:53.225135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:53.233971 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dce89a1d-2144-418c-bd94-0c4c9a45be1d tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1453 microversion: 2.1 time: 0.154696 Aug 22 11:14:53.235387 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 525/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:53 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:53.235863 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f86a253c-1835-4168-8947-f6c877a14a88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117401 Aug 22 11:14:53.236452 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 515/1040] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 22 11:14:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:14:53.257131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:53.257735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:53.263536 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:53.264015 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:53.264449 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:53.265691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:53.266141 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:53.266591 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:53.441094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:53.449236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d04d1967-146c-4ac8-a6a6-b15ef5f438d7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1453 microversion: 2.1 time: 0.195887 Aug 22 11:14:53.449843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 526/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:53 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:55.753784 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-4bf8ddac-3368-40f8-b63a-aeb69a2e8bed req-555bf055-2df3-4173-bb88-ae16c5aa7482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d654e40-0fcf-46a6-938f-a784f1e7f736", "tag": "4065871f-1795-46ad-ae8f-c7969723a9fa"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:55.767659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4bf8ddac-3368-40f8-b63a-aeb69a2e8bed req-555bf055-2df3-4173-bb88-ae16c5aa7482 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:55.768098 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4bf8ddac-3368-40f8-b63a-aeb69a2e8bed req-555bf055-2df3-4173-bb88-ae16c5aa7482 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:55.768771 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4bf8ddac-3368-40f8-b63a-aeb69a2e8bed req-555bf055-2df3-4173-bb88-ae16c5aa7482 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:55.784393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-4bf8ddac-3368-40f8-b63a-aeb69a2e8bed req-555bf055-2df3-4173-bb88-ae16c5aa7482 service nova] Creating event network-changed:4065871f-1795-46ad-ae8f-c7969723a9fa for instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 on hv-cinder-85394 Aug 22 11:14:55.789801 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-4bf8ddac-3368-40f8-b63a-aeb69a2e8bed req-555bf055-2df3-4173-bb88-ae16c5aa7482 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040778 Aug 22 11:14:55.790447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 516/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:14:55.869089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1914661408", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32628a3c-4097-4727-8760-fd5c690f58fc"}], "security_groups": [{"name": "tempest-securitygroup--540743446"}], "key_name": "tempest-keypair-1940977656", "user_data": "}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:14:55.984135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] validate_networks() for [('32628a3c-4097-4727-8760-fd5c690f58fc', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:14:56.460971 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:14:56.461467 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:14:56.462042 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:14:56.462675 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:14:56.463276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:14:56.473084 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:56.473572 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:56.474006 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:56.474779 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:56.475229 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:56.475663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:56.494568 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for project 6a293d557d674e8d97596857b8d179b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:14:56.498882 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Getting quotas for user 2f8117e04a1d4f7aa802df3dda87606e and project 6a293d557d674e8d97596857b8d179b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:14:56.511732 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:14:56.514127 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:14:56.694167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-86991e2e-848c-4305-9781-01a03bdcf8bb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.829813 Aug 22 11:14:56.694843 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 527/1043] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:14:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:14:56.706964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ee963f3c-3337-48d5-90ac-6592b437422f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:56.707690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ee963f3c-3337-48d5-90ac-6592b437422f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:56.771404 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ee963f3c-3337-48d5-90ac-6592b437422f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:56.779202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ee963f3c-3337-48d5-90ac-6592b437422f tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1238 microversion: 2.1 time: 0.077057 Aug 22 11:14:56.779767 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 517/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:56 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:57.800893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:57.801474 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:57.807470 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:57.812202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:57.812202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:57.812202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:57.812202 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:57.812726 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:57.874156 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:57.881818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-229b2036-eb23-4293-a17e-ff9e7f23ddf2 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1242 microversion: 2.1 time: 0.085420 Aug 22 11:14:57.882389 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 528/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:57 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:14:58.903099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:14:58.903806 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:14:58.910869 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:58.911353 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:58.911786 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:58.912480 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:14:58.913685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:14:58.913685 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:14:58.990718 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:14:58.999077 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ba5ceae5-b1c6-4482-8852-68edf34ffe97 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1298 microversion: 2.1 time: 0.099919 Aug 22 11:14:58.999943 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 518/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:14:58 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:00.021312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:00.021927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:00.028328 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:00.028812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:00.029247 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:00.029960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:00.030456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:00.030970 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:00.051071 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=100 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:00.169010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:00.177563 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0518b7ef-569e-4f34-9eaf-61136d555262 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.160129 Aug 22 11:15:00.178160 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 529/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:00 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:15:00.777066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-4baad3c0-58fe-4ec2-b319-285c8cfcd049 req-da68377e-5318-484b-981b-fdf17d080787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01eb23a-9f08-4754-a967-53596377ac5d", "tag": "3208dce5-fce8-4541-8b97-168608480b66"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:15:00.782683 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:00.788619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4baad3c0-58fe-4ec2-b319-285c8cfcd049 req-da68377e-5318-484b-981b-fdf17d080787 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:00.789102 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4baad3c0-58fe-4ec2-b319-285c8cfcd049 req-da68377e-5318-484b-981b-fdf17d080787 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:00.789531 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4baad3c0-58fe-4ec2-b319-285c8cfcd049 req-da68377e-5318-484b-981b-fdf17d080787 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:00.802847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-4baad3c0-58fe-4ec2-b319-285c8cfcd049 req-da68377e-5318-484b-981b-fdf17d080787 service nova] Creating event network-changed:3208dce5-fce8-4541-8b97-168608480b66 for instance f01eb23a-9f08-4754-a967-53596377ac5d on hv-cinder-85394 Aug 22 11:15:00.807620 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-4baad3c0-58fe-4ec2-b319-285c8cfcd049 req-da68377e-5318-484b-981b-fdf17d080787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097035 Aug 22 11:15:00.808208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 519/1048] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:01.199154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:01.199759 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:01.202066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:01.207404 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:01.207887 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:01.208362 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:01.209049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:01.209500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:01.209920 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:01.341010 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:01.349037 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-38f92ba2-6f53-488e-8e33-b0f68c08a3bc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.153857 Aug 22 11:15:01.349600 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 530/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:01 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:02.373010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:02.374348 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:02.382794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:02.383486 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:02.384174 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:02.384880 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:02.385500 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:02.386100 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:02.601259 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:02.609053 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5f6fbec9-6526-4b3d-b497-646b58ee704c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.241076 Aug 22 11:15:02.609633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 520/1050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:02 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:03.631910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:03.632537 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:03.639070 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:03.639548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:03.640181 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:03.641066 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:03.641526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:03.641951 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:03.772308 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:03.779818 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-312ddd00-8907-48ff-b29f-b17d1d0a0034 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.151891 Aug 22 11:15:03.780413 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 531/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:03 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:04.801653 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:04.802305 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:04.808827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:04.809315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:04.809757 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:04.810608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:04.811068 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:04.811497 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:04.945607 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:04.953312 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9ad8dd2c-a089-4f6e-95c1-2611cb024d42 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.155627 Aug 22 11:15:04.953888 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 521/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:04 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:05.972987 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:05.973596 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:05.980144 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:05.980627 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:05.981061 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:05.981748 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:05.982196 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:05.982645 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:06.118361 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:06.126912 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-294500d3-3ff1-4c93-8e9a-b29553965769 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.157785 Aug 22 11:15:06.127493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 532/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:05 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:06.260012 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-6941f0ef-9cc5-459d-85d8-c8f37be99fe1 req-5c96a95b-8262-47bd-8c1c-57784d4c7ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01eb23a-9f08-4754-a967-53596377ac5d", "name": "network-vif-plugged", "status": "completed", "tag": "3208dce5-fce8-4541-8b97-168608480b66"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:15:06.269280 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6941f0ef-9cc5-459d-85d8-c8f37be99fe1 req-5c96a95b-8262-47bd-8c1c-57784d4c7ed5 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:06.269758 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6941f0ef-9cc5-459d-85d8-c8f37be99fe1 req-5c96a95b-8262-47bd-8c1c-57784d4c7ed5 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:06.270195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6941f0ef-9cc5-459d-85d8-c8f37be99fe1 req-5c96a95b-8262-47bd-8c1c-57784d4c7ed5 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:06.281735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-6941f0ef-9cc5-459d-85d8-c8f37be99fe1 req-5c96a95b-8262-47bd-8c1c-57784d4c7ed5 service nova] Creating event network-vif-plugged:3208dce5-fce8-4541-8b97-168608480b66 for instance f01eb23a-9f08-4754-a967-53596377ac5d on hv-cinder-85394 Aug 22 11:15:06.286797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-6941f0ef-9cc5-459d-85d8-c8f37be99fe1 req-5c96a95b-8262-47bd-8c1c-57784d4c7ed5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084518 Aug 22 11:15:06.287391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 522/1054] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:07.148063 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:07.148580 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:07.150468 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:07.151183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=6 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:07.156239 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:07.156719 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:07.157154 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:07.157842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:07.158335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:07.158760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:07.293569 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:07.301192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-898b18d1-8c17-4a67-85be-0c122fffe09a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1363 microversion: 2.1 time: 0.157070 Aug 22 11:15:07.301795 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 533/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:07 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:08.318971 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:08.323524 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:08.324427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:08.330724 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:08.331211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:08.331646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:08.332352 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:08.332830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:08.333250 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:08.468166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:15:08.476000 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8d1db350-2f6e-4d2f-89bb-de38c0c635b8 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1549 microversion: 2.1 time: 0.158126 Aug 22 11:15:08.476559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 523/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:15:08 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:15:08.496634 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:08.497171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:08.504310 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:08.504793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:08.505228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:08.505914 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:08.506410 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:08.506835 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:08.581314 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-61c62b19-c0a2-464d-8d06-1a82d5f4340c tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088791 Aug 22 11:15:08.581909 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 534/1057] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 22 11:15:08 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:09.560662 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-88b2b64f-c6c5-499b-aabc-b68fd73be01b req-71836159-a229-4b2f-88d5-2c2a6d40a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01eb23a-9f08-4754-a967-53596377ac5d", "tag": "3208dce5-fce8-4541-8b97-168608480b66"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:15:09.571201 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-88b2b64f-c6c5-499b-aabc-b68fd73be01b req-71836159-a229-4b2f-88d5-2c2a6d40a5d1 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:09.571597 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-88b2b64f-c6c5-499b-aabc-b68fd73be01b req-71836159-a229-4b2f-88d5-2c2a6d40a5d1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:09.572023 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-88b2b64f-c6c5-499b-aabc-b68fd73be01b req-71836159-a229-4b2f-88d5-2c2a6d40a5d1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:09.583458 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-88b2b64f-c6c5-499b-aabc-b68fd73be01b req-71836159-a229-4b2f-88d5-2c2a6d40a5d1 service nova] Creating event network-changed:3208dce5-fce8-4541-8b97-168608480b66 for instance f01eb23a-9f08-4754-a967-53596377ac5d on hv-cinder-85394 Aug 22 11:15:09.588073 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-88b2b64f-c6c5-499b-aabc-b68fd73be01b req-71836159-a229-4b2f-88d5-2c2a6d40a5d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Aug 22 11:15:09.588649 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 524/1058] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:45.584849 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=9 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:45.585626 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=30 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:45.589520 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:45.590003 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:45.596454 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:45.596968 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:45.597398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:45.598078 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:45.598548 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:45.601498 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:45.622372 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5cf1bbc2-bff3-4e43-b40c-faed16ed9da6 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/ips" status: 200 len: 146 microversion: 2.1 time: 0.038903 Aug 22 11:15:45.622982 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 535/1059] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 22 11:15:45 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:47.191203 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=11 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:47.192012 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=44 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:15:47.196207 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b07fe84-b41d-4b9d-b32b-dc41186d0f3d"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:15:47.198648 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:47.205196 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:47.205676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:47.206101 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:47.206828 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:47.207275 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:47.207690 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:47.860634 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1d32c7e-62b4-45cc-8abc-26d913f24065 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670440 Aug 22 11:15:47.861113 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 525/1060] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:15:47 2022] POST /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:55.382854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:55.385147 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:55.392401 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:55.392866 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:55.393291 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:55.393983 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:55.394445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:55.394863 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:55.424081 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-8a2af4cf-cc9e-4444-9f78-8676318726cb tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Aug 22 11:15:55.424618 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 536/1061] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:15:55 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:55.436010 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:15:55.436584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:55.443554 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:55.444042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:55.444495 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:55.445169 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:55.445619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:55.446042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:55.475549 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8e0cb45f-4b50-406d-ba81-a02176fbcc43 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/1b07fe84-b41d-4b9d-b32b-dc41186d0f3d" status: 200 len: 194 microversion: 2.1 time: 0.044299 Aug 22 11:15:55.476125 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 526/1062] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 22 11:15:55 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/1b07fe84-b41d-4b9d-b32b-dc41186d0f3d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:15:57.103177 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "963e8808-2bd1-4460-a97b-1edf862fab8b"}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:15:57.105524 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:15:57.112119 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:57.112536 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:57.112967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:57.113651 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:15:57.114108 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:15:57.114594 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:15:57.925650 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-dad5657c-f4e4-438e-96d4-455decc3079d tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "POST /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826172 Aug 22 11:15:57.926312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 537/1063] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 22 11:15:57 2022] POST /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:16:05.445166 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:05.447541 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:05.450131 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:05.454918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:05.455619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:05.456059 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:05.456769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:05.457233 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:05.457659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:05.488493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e8c596ac-caac-4313-b4df-9e1589959393 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047230 Aug 22 11:16:05.489048 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 527/1064] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:16:05 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:16:05.644621 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:05.645167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:05.651772 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:05.652251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:05.652756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:05.653473 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:05.653917 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:05.654368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:05.683793 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5677bcd5-207c-4b44-9d2b-74fc727d8b02 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/1b07fe84-b41d-4b9d-b32b-dc41186d0f3d" status: 200 len: 194 microversion: 2.1 time: 0.043567 Aug 22 11:16:05.684368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 538/1065] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 22 11:16:05 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/1b07fe84-b41d-4b9d-b32b-dc41186d0f3d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:16:05.695488 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:05.695989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:05.701922 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:05.702451 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:05.702895 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:05.703581 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:05.704038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:05.704516 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:05.783730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lazy-loading 'services' on Instance uuid f01eb23a-9f08-4754-a967-53596377ac5d {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:16:06.069127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1939a15-2b51-499e-85cd-65e4dbd3be65 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/1b07fe84-b41d-4b9d-b32b-dc41186d0f3d" status: 202 len: 0 microversion: 2.1 time: 0.377692 Aug 22 11:16:06.069733 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 528/1066] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:16:05 2022] DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/1b07fe84-b41d-4b9d-b32b-dc41186d0f3d => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:16:08.242463 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:08.242975 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:08.249588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:08.250068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:08.250542 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:08.251273 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:08.251842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:08.252366 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:08.280735 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2bb9e505-a9cc-4406-9188-d8054afaf245 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/963e8808-2bd1-4460-a97b-1edf862fab8b" status: 200 len: 194 microversion: 2.1 time: 0.042212 Aug 22 11:16:08.281309 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 539/1067] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 22 11:16:08 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/963e8808-2bd1-4460-a97b-1edf862fab8b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:16:08.293392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:08.293965 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:08.300074 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:08.300562 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:08.300973 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:08.301646 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:08.302090 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:08.302550 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:08.381025 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lazy-loading 'services' on Instance uuid f01eb23a-9f08-4754-a967-53596377ac5d {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:16:08.614435 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ee546788-7514-4184-b35b-2bfe8cc6b52e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/963e8808-2bd1-4460-a97b-1edf862fab8b" status: 202 len: 0 microversion: 2.1 time: 0.325552 Aug 22 11:16:08.615016 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 529/1068] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 22 11:16:08 2022] DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments/963e8808-2bd1-4460-a97b-1edf862fab8b => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:16:09.785560 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:09.787803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:09.794046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:09.794568 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:09.795002 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:09.795680 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:09.796128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:09.796549 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:09.825706 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-7d022aa6-038d-4a8d-882f-7beaba0cd9aa tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044174 Aug 22 11:16:09.826175 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 540/1069] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:16:09 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:16:09.940553 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:09.943884 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:09.950095 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:09.950615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:09.951052 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:09.951747 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:09.952197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:09.952621 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:09.981185 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2d7ebc4a-487f-422a-ad97-c0311bbc7138 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046894 Aug 22 11:16:09.981749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 530/1070] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 22 11:16:09 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 11:16:10.042513 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:10.043007 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:10.049435 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:10.049909 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:10.050376 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:10.051057 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:10.051510 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:10.051931 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:10.076230 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:16:10.355718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2034b60b-520e-4477-9351-cd881f354bfd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 204 len: 0 microversion: 2.1 time: 0.316267 Aug 22 11:16:10.356396 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 541/1071] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:16:10 2022] DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:16:10.370388 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:10.371001 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:10.377428 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:10.377897 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:10.378368 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:10.379062 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:10.379512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:10.379934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:10.509079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:10.517281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e381de55-72fc-4436-a6f3-dd9794028f7a tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1674 microversion: 2.1 time: 0.150325 Aug 22 11:16:10.517845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 531/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:10 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:11.539526 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:11.540584 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:11.547453 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:11.547939 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:11.549214 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:11.550482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:11.551315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:11.551859 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:11.686826 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:11.694702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0b8e29e8-cab8-48e1-88bb-48d0b1a60a0b tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1674 microversion: 2.1 time: 0.159358 Aug 22 11:16:11.695305 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 542/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:11 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:12.716361 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:12.716989 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:12.724472 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:12.724964 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:12.725405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:12.726102 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:12.726586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:12.727013 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:12.913870 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:12.921667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-22850860-d929-4152-b5c2-48db92a92396 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1674 microversion: 2.1 time: 0.209177 Aug 22 11:16:12.922706 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 532/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:12 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:13.626633 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-ba5a9e12-e24f-4808-9d99-8b44aeb7666f req-6b9ebd8d-f014-473c-9811-9591fbd0baed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01eb23a-9f08-4754-a967-53596377ac5d", "name": "network-vif-deleted", "tag": "3208dce5-fce8-4541-8b97-168608480b66"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:16:13.636988 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-ba5a9e12-e24f-4808-9d99-8b44aeb7666f req-6b9ebd8d-f014-473c-9811-9591fbd0baed service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:13.637459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-ba5a9e12-e24f-4808-9d99-8b44aeb7666f req-6b9ebd8d-f014-473c-9811-9591fbd0baed service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:13.637911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-ba5a9e12-e24f-4808-9d99-8b44aeb7666f req-6b9ebd8d-f014-473c-9811-9591fbd0baed service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:13.649527 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-ba5a9e12-e24f-4808-9d99-8b44aeb7666f req-6b9ebd8d-f014-473c-9811-9591fbd0baed service nova] Creating event network-vif-deleted:3208dce5-fce8-4541-8b97-168608480b66 for instance f01eb23a-9f08-4754-a967-53596377ac5d on hv-cinder-85394 Aug 22 11:16:13.654623 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-ba5a9e12-e24f-4808-9d99-8b44aeb7666f req-6b9ebd8d-f014-473c-9811-9591fbd0baed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Aug 22 11:16:13.655274 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 543/1075] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:16:13.943633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:13.949457 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:13.951189 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:13.951769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:13.952309 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:13.953084 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:13.953771 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:13.954351 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:13.987660 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:13.988142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:13.988574 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:13.989037 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lazy-loading 'fault' on Instance uuid f01eb23a-9f08-4754-a967-53596377ac5d {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:16:14.035433 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f8117e04a1d4f7aa802df3dda87606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a293d557d674e8d97596857b8d179b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:14.041045 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d9bfec7-baa3-4a99-89ae-fcc2bb5bfc1e tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 200 len: 1328 microversion: 2.1 time: 0.102019 Aug 22 11:16:14.041667 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 533/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:13 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:15.061729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:15.062456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:15.069694 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:15.070192 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:15.070637 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:15.071326 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:15.071777 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:15.072198 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:15.085170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] HTTP exception thrown: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Request method failure captured: Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d HTTP/1.1 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2R5MVDyu_aq2PhxCfKnsHG0PzO3k7gn8ISw0WXHVYvB6IHxBP_fmNg8x53x2l1IIzX3XBUX4lmeT92ClNl3FqcTArH93KZZtk_4fd3j3yk9WE7XA5L8n-GFkqDROzQb7lOr1Sh2S8jEh8mrnvXVgK0-gAXWOnF5pxhNxBevJNvzy-4 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:16:15.086809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a293d557d674e8d97596857b8d179b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 2f8117e04a1d4f7aa802df3dda87606e Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:15.088523 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'f01eb23a-9f08-4754-a967-53596377ac5d'} Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:16:15.089545 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:15.091232 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:15.092781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Returning 404 to user: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:16:15.092781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-a8f552cd-6a4e-4447-8a45-38fa7869e6cd tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 404 len: 111 microversion: 2.1 time: 0.030696 Aug 22 11:16:15.092781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 544/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:15 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:16:15.097492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2da79e31-5483-49c7-8f46-7b1c9a1f32dc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '.version_select at 0x7f3b4c977550>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:15.170932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2da79e31-5483-49c7-8f46-7b1c9a1f32dc tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940977656" status: 202 len: 0 microversion: 2.1 time: 0.077408 Aug 22 11:16:15.171517 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 534/1078] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 22 11:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940977656 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:16:18.442852 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:18.443341 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:18.449707 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:18.450184 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:18.450654 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:18.451342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:18.451790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:18.452207 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:18.466115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] HTTP exception thrown: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Request method failure captured: Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d HTTP/1.1 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2R5MVDyu_aq2PhxCfKnsHG0PzO3k7gn8ISw0WXHVYvB6IHxBP_fmNg8x53x2l1IIzX3XBUX4lmeT92ClNl3FqcTArH93KZZtk_4fd3j3yk9WE7XA5L8n-GFkqDROzQb7lOr1Sh2S8jEh8mrnvXVgK0-gAXWOnF5pxhNxBevJNvzy-4 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:16:18.467659 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a293d557d674e8d97596857b8d179b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 2f8117e04a1d4f7aa802df3dda87606e Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.469312 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'f01eb23a-9f08-4754-a967-53596377ac5d'} Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:16:18.470162 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.471715 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.473611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Returning 404 to user: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:16:18.473611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-16191288-9724-4916-b2e9-7012756cac88 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 404 len: 111 microversion: 2.1 time: 0.030667 Aug 22 11:16:18.473611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 545/1079] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:16:18 2022] DELETE /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:16:18.478172 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:18.478835 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: f01eb23a-9f08-4754-a967-53596377ac5d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:18.485489 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:18.485978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:18.486455 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:18.487153 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:18.487765 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:18.488387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:18.491142 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:18.502395 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] HTTP exception thrown: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Request method failure captured: Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d HTTP/1.1 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2R5MVDyu_aq2PhxCfKnsHG0PzO3k7gn8ISw0WXHVYvB6IHxBP_fmNg8x53x2l1IIzX3XBUX4lmeT92ClNl3FqcTArH93KZZtk_4fd3j3yk9WE7XA5L8n-GFkqDROzQb7lOr1Sh2S8jEh8mrnvXVgK0-gAXWOnF5pxhNxBevJNvzy-4 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:16:18.504608 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a293d557d674e8d97596857b8d179b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 2f8117e04a1d4f7aa802df3dda87606e Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.506320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'f01eb23a-9f08-4754-a967-53596377ac5d'} Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:16:18.511654 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. Aug 22 11:16:18.513181 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:18.514568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Returning 404 to user: Instance f01eb23a-9f08-4754-a967-53596377ac5d could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:16:18.514568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f7420349-cef6-490a-83ee-c42f4bed11e5 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d" status: 404 len: 111 microversion: 2.1 time: 0.032353 Aug 22 11:16:18.514568 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 535/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:18 2022] GET /compute/v2.1/servers/f01eb23a-9f08-4754-a967-53596377ac5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 11:16:19.782733 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:19.783219 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:19.789616 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:19.790102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:19.790565 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:19.791247 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:19.791696 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:19.792116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:19.805728 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] HTTP exception thrown: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Request method failure captured: Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 HTTP/1.1 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2R5MVDyu_aq2PhxCfKnsHG0PzO3k7gn8ISw0WXHVYvB6IHxBP_fmNg8x53x2l1IIzX3XBUX4lmeT92ClNl3FqcTArH93KZZtk_4fd3j3yk9WE7XA5L8n-GFkqDROzQb7lOr1Sh2S8jEh8mrnvXVgK0-gAXWOnF5pxhNxBevJNvzy-4 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:16:19.807311 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a293d557d674e8d97596857b8d179b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 2f8117e04a1d4f7aa802df3dda87606e Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.808960 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'c80d1789-b4f0-4d30-b867-33cdd1f56f16'} Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:16:19.810101 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.811642 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.813276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Returning 404 to user: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:16:19.813276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-866d73ab-50fb-4cbe-ae11-3c0a8ee2dbca tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 404 len: 111 microversion: 2.1 time: 0.029884 Aug 22 11:16:19.813276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 546/1081] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:16:19 2022] DELETE /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:16:19.818006 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:19.818681 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] [instance: c80d1789-b4f0-4d30-b867-33cdd1f56f16] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:19.825325 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:19.825805 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:19.826248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:19.826941 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:19.827391 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:19.827818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:19.840825 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] HTTP exception thrown: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Request method failure captured: Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 HTTP/1.1 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2R5MVDyu_aq2PhxCfKnsHG0PzO3k7gn8ISw0WXHVYvB6IHxBP_fmNg8x53x2l1IIzX3XBUX4lmeT92ClNl3FqcTArH93KZZtk_4fd3j3yk9WE7XA5L8n-GFkqDROzQb7lOr1Sh2S8jEh8mrnvXVgK0-gAXWOnF5pxhNxBevJNvzy-4 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:16:19.842358 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a293d557d674e8d97596857b8d179b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a293d557d674e8d97596857b8d179b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 6a293d557d674e8d97596857b8d179b3 Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-173096281 Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 2f8117e04a1d4f7aa802df3dda87606e Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeTestJSON-173096281-project Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.843947 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': 'c80d1789-b4f0-4d30-b867-33cdd1f56f16'} Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:16:19.845230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. Aug 22 11:16:19.847019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:16:19.848795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] Returning 404 to user: Instance c80d1789-b4f0-4d30-b867-33cdd1f56f16 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:16:19.848795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eab91abf-d934-4462-9e1f-ab3657949eb3 tempest-AttachVolumeTestJSON-173096281 tempest-AttachVolumeTestJSON-173096281-project] 10.222.0.48 "GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16" status: 404 len: 111 microversion: 2.1 time: 0.030605 Aug 22 11:16:19.848795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 536/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:19 2022] GET /compute/v2.1/servers/c80d1789-b4f0-4d30-b867-33cdd1f56f16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:16:43.559919 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-29616905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1340322727", "security_groups": [{"name": "tempest-secgroup-smoke-880797226"}], "block_device_mapping_v2": [{"uuid": "e7fabac6-1f52-4cd7-8ba2-fe2d9243d2f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da84f983-c836-4e5d-af59-0093967b20f3"}]}} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:16:43.570717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:43.573620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:43.682816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.network.neutron [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] validate_networks() for [('da84f983-c836-4e5d-af59-0093967b20f3', None, None, None, None, None)] {{(pid=121143) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:16:44.067142 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Flavor limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:16:44.068327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Image limits 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:16:44.069236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Flavor pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:16:44.069718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Image pref 0:0:0 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:16:44.070256 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.virt.hardware [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121143) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:16:44.078869 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:44.079342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:44.079766 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:44.080482 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:44.080928 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:44.081343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:44.098262 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for project 02c34172aa804fe695944f629a348c58. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:16:44.104445 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.quota [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Getting quotas for user 9ca8c5d1971a4ec1a448f2081ceb835b and project 02c34172aa804fe695944f629a348c58. Resources: {'cores', 'ram', 'instances'} {{(pid=121143) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:16:44.169294 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Going to run 1 instances... {{(pid=121143) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:16:44.171459 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7fabac6-1f52-4cd7-8ba2-fe2d9243d2f9',volume_size=None,volume_type=None)] {{(pid=121143) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:16:44.587743 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fb8f8cb6-103c-4aa7-99b8-4286b9f2acdb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031705 Aug 22 11:16:44.588835 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 547/1083] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:16:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:16:44.604204 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-24e0ad5f-af26-4535-93bf-74ae72729df3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:44.605539 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-24e0ad5f-af26-4535-93bf-74ae72729df3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:44.609038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:44.674779 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-24e0ad5f-af26-4535-93bf-74ae72729df3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:44.684559 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-24e0ad5f-af26-4535-93bf-74ae72729df3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1093 microversion: 2.1 time: 0.088346 Aug 22 11:16:44.686109 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 537/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:44 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:45.706461 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:45.707145 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:45.714251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:45.714765 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:45.715199 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:45.715892 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:45.716360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:45.716768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:45.785781 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:45.793532 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5929d9d4-adac-43f0-809b-bc53e62b13ef tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1143 microversion: 2.1 time: 0.091476 Aug 22 11:16:45.794087 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 548/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:45 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:46.815009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:46.815695 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:46.823696 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:46.824191 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:46.824629 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:46.825337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:46.826152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:46.826612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:46.925099 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:46.933137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c1b5ec1-328f-4fff-977e-39998b215e83 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1209 microversion: 2.1 time: 0.122549 Aug 22 11:16:46.933700 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 538/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:46 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:47.953209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:47.954432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:47.963676 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:47.964838 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:47.965485 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:47.967234 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:47.968061 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:47.968716 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:48.118974 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:48.126911 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-92cc307f-3207-4659-8f3e-0dd7b4ceced1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1276 microversion: 2.1 time: 0.177887 Aug 22 11:16:48.127516 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 549/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:47 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:48.190866 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-c45e4a94-45ba-4d56-8c0a-81ea620fbe33 req-a6a6055b-0ec9-4fdc-91d5-61c1fad9c1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6", "tag": "76fdf4ae-a83b-4685-a786-3056b34a2406"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:16:48.200688 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c45e4a94-45ba-4d56-8c0a-81ea620fbe33 req-a6a6055b-0ec9-4fdc-91d5-61c1fad9c1f0 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:48.201159 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c45e4a94-45ba-4d56-8c0a-81ea620fbe33 req-a6a6055b-0ec9-4fdc-91d5-61c1fad9c1f0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:48.201580 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c45e4a94-45ba-4d56-8c0a-81ea620fbe33 req-a6a6055b-0ec9-4fdc-91d5-61c1fad9c1f0 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:48.213230 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-c45e4a94-45ba-4d56-8c0a-81ea620fbe33 req-a6a6055b-0ec9-4fdc-91d5-61c1fad9c1f0 service nova] Creating event network-changed:76fdf4ae-a83b-4685-a786-3056b34a2406 for instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 on hv-cinder-85394 Aug 22 11:16:48.218236 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-c45e4a94-45ba-4d56-8c0a-81ea620fbe33 req-a6a6055b-0ec9-4fdc-91d5-61c1fad9c1f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031189 Aug 22 11:16:48.218845 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 539/1088] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:16:49.148055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:49.148628 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:49.155012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:49.155489 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:49.158170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:49.158170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:49.158170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:49.158170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:49.291276 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:49.298854 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-95a0e805-dde5-47b5-8288-3e1c48314534 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.155034 Aug 22 11:16:49.299411 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 550/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:49 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:50.321331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:50.322015 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:50.328034 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:50.328506 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:50.328936 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:50.329612 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:50.330056 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:50.330502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:50.464726 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:50.472492 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6563f93d-6ca4-4896-8abf-83576626f115 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.155954 Aug 22 11:16:50.473019 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 540/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:50 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:51.495115 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:51.495755 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:51.502284 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:51.502747 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:51.503186 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:51.503875 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:51.504332 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:51.504759 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:51.641672 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:51.650427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4792a6ce-6b46-49d1-bf94-be80fc1261fd tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.160255 Aug 22 11:16:51.651000 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 551/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:51 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:52.671026 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:52.676769 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:52.678036 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:52.679216 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:52.679683 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:52.680377 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:52.680832 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:52.681255 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:52.817604 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:52.825826 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77737025-6261-4cf9-9506-cc3cdfac8430 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.158549 Aug 22 11:16:52.826467 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 541/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:52 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:53.846767 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:53.847457 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:53.854611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:53.855100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:53.855557 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:53.856246 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:53.856704 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:53.857130 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:53.993190 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:54.001200 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-2c56be11-4edf-46a0-b380-352ed968f036 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.158323 Aug 22 11:16:54.001760 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 552/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:53 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:55.022020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:55.022768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:55.024956 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:55.029641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:55.030124 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:55.030659 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:55.031345 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:55.031809 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:55.032221 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:55.166626 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:55.174252 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fdc6341f-3e42-48a1-b5f1-f59e0432af38 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.156183 Aug 22 11:16:55.174800 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 542/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:55 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:56.195088 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:56.195668 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:56.197553 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:56.198274 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=6 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:16:56.209290 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:56.209809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:56.210357 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:56.211005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:56.211493 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:56.211912 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:56.345588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:56.354102 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-55a9a183-ec88-40c8-a706-56fbe1bc51f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.163554 Aug 22 11:16:56.354697 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 553/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:56 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:57.375590 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:57.376215 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:57.383236 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:57.387331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:57.387331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:57.387331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:57.387331 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:57.387783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:57.519656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:57.527509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c5f49f4d-d726-4701-961f-c808f910c622 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.156049 Aug 22 11:16:57.528075 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 543/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:57 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:16:58.548250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:58.548857 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:58.556167 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:58.556655 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:58.557090 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:58.557780 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:58.558250 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:58.558682 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:58.696506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:58.697758 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e231ceb7-7cb2-43ec-9c2d-19e17d454675 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.153363 Aug 22 11:16:58.698344 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 554/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:58 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:16:59.718134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:16:59.718916 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:16:59.726304 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:59.726799 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:59.727235 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:59.727955 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:16:59.728403 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:16:59.728847 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:16:59.866687 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:16:59.876122 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b1c13f42-d622-4fbf-9d06-adc13375bacf tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.161875 Aug 22 11:16:59.876683 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 544/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:16:59 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:17:00.897613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:17:00.898327 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:17:00.904593 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:00.908209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:00.908209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:00.908209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:00.908209 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:00.908620 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:01.042753 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:17:01.051681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-d5ac2e7b-b5e7-4f68-a754-87be02713cf8 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.157510 Aug 22 11:17:01.051681 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 555/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:17:00 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:17:01.983892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-c7124454-8dd2-42ad-9753-b38477b3fce9 req-c53b04f1-46c6-45c1-8664-8f4334ccb93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6", "name": "network-vif-plugged", "status": "completed", "tag": "76fdf4ae-a83b-4685-a786-3056b34a2406"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:17:01.994357 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c7124454-8dd2-42ad-9753-b38477b3fce9 req-c53b04f1-46c6-45c1-8664-8f4334ccb93a service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:01.994830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c7124454-8dd2-42ad-9753-b38477b3fce9 req-c53b04f1-46c6-45c1-8664-8f4334ccb93a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:01.995258 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c7124454-8dd2-42ad-9753-b38477b3fce9 req-c53b04f1-46c6-45c1-8664-8f4334ccb93a service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:02.007107 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-c7124454-8dd2-42ad-9753-b38477b3fce9 req-c53b04f1-46c6-45c1-8664-8f4334ccb93a service nova] Creating event network-vif-plugged:76fdf4ae-a83b-4685-a786-3056b34a2406 for instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 on hv-cinder-85394 Aug 22 11:17:02.012167 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-c7124454-8dd2-42ad-9753-b38477b3fce9 req-c53b04f1-46c6-45c1-8664-8f4334ccb93a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Aug 22 11:17:02.012774 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 545/1100] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:17:02.071757 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:17:02.072368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:17:02.079402 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:02.080135 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:02.080576 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:02.081315 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:02.081803 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:02.082252 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:02.228360 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:17:02.236570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fb16e12c-f31c-4727-b1b5-5f2f3cff64e3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.168732 Aug 22 11:17:02.241643 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 556/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:17:02 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:17:03.259370 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:17:03.260089 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:17:03.266173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:03.266676 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:03.267105 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:03.267783 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:03.268228 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:03.268645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:03.402474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:17:03.410586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2dfb6ca8-54ad-4e6b-b94c-427ae41c8e23 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1264 microversion: 2.1 time: 0.156449 Aug 22 11:17:03.411211 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 546/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:17:03 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:17:04.432506 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:17:04.433110 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:17:04.439398 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:04.439870 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:04.440298 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:04.440976 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:04.441427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:04.441842 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:04.572128 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:17:04.580068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-93830e91-e0e8-48a9-9dcc-ecace89bee81 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1451 microversion: 2.1 time: 0.152020 Aug 22 11:17:04.580639 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 557/1103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:17:04 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:17:04.600684 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:17:04.601295 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:17:04.607645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:04.608129 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:04.608565 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:04.609320 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:04.609776 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:04.610303 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:04.745397 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:17:04.753365 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0dc5d8ab-4b55-431f-9438-93ad589cc4ed tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1451 microversion: 2.1 time: 0.157103 Aug 22 11:17:04.753932 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 547/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:17:04 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:17:06.988183 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-e7550c4c-b4f3-4b3e-b811-a65e06503fc0 req-3dbb0acd-3cae-4273-ab10-19674462f74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6", "tag": "76fdf4ae-a83b-4685-a786-3056b34a2406"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:17:06.999272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-e7550c4c-b4f3-4b3e-b811-a65e06503fc0 req-3dbb0acd-3cae-4273-ab10-19674462f74b service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:17:07.000424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-e7550c4c-b4f3-4b3e-b811-a65e06503fc0 req-3dbb0acd-3cae-4273-ab10-19674462f74b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:17:07.000424 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-e7550c4c-b4f3-4b3e-b811-a65e06503fc0 req-3dbb0acd-3cae-4273-ab10-19674462f74b service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:17:07.012303 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-e7550c4c-b4f3-4b3e-b811-a65e06503fc0 req-3dbb0acd-3cae-4273-ab10-19674462f74b service nova] Creating event network-changed:76fdf4ae-a83b-4685-a786-3056b34a2406 for instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 on hv-cinder-85394 Aug 22 11:17:07.017193 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-e7550c4c-b4f3-4b3e-b811-a65e06503fc0 req-3dbb0acd-3cae-4273-ab10-19674462f74b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032630 Aug 22 11:17:07.017809 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 558/1105] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:17:49.457585 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:17:49.458171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Mon Aug 22 11:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:17:51.153885 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:17:51.154439 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Mon Aug 22 11:17:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:18:31.042466 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=24 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:31.043209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=55 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:31.047983 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1141316985", "imageRef": "f5d45e64-d2ce-467b-8a29-9f6918bf5820", "flavorRef": "452"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:31.100528 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] validate_networks() for None {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 11:18:31.374827 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 11:18:31.375393 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 11:18:31.375909 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 11:18:31.376318 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 11:18:31.376729 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 11:18:31.385392 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:31.385869 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:31.386387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:31.387054 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:31.387501 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:31.387918 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:31.404716 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Getting quotas for project ad6ff5a309d244f9ac20399bff4dcc27. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 11:18:31.409441 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Getting quotas for user aadc4ee42aa14dff8860e7dc84ff4e0b and project ad6ff5a309d244f9ac20399bff4dcc27. Resources: {'cores', 'ram', 'instances'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 11:18:31.420197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 11:18:31.423081 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5d45e64-d2ce-467b-8a29-9f6918bf5820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 11:18:31.554838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-be3532cb-cdf0-4314-8644-ababb2084648 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514036 Aug 22 11:18:31.555474 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 548/1106] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 22 11:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 11:18:31.565170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:31.565925 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=64 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:31.571836 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4967deea-ad47-4105-8f3b-a28c883c359a tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:31.572718 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4967deea-ad47-4105-8f3b-a28c883c359a tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:31.627011 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4967deea-ad47-4105-8f3b-a28c883c359a tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:31.634317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4967deea-ad47-4105-8f3b-a28c883c359a tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1215 microversion: 2.1 time: 0.071739 Aug 22 11:18:31.634879 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 559/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:31 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:32.655387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0dabb853-eda7-457f-9abf-b0e5dcab98f5 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:32.656229 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0dabb853-eda7-457f-9abf-b0e5dcab98f5 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:32.715212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0dabb853-eda7-457f-9abf-b0e5dcab98f5 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:32.722826 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0dabb853-eda7-457f-9abf-b0e5dcab98f5 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1215 microversion: 2.1 time: 0.072045 Aug 22 11:18:32.723389 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 549/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:32 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:33.743961 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:33.744567 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:33.753691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:33.754173 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:33.754632 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:33.755320 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:33.755798 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:33.756226 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:33.820335 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:33.829035 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e009e755-7242-45a5-b5ec-98f8ea623cb1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1267 microversion: 2.1 time: 0.088875 Aug 22 11:18:33.836418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 560/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:33 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:34.849388 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:34.849994 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:34.856934 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:34.857508 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:34.858146 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:34.858927 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:34.859470 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:34.860228 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:34.929224 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:34.946418 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97456902-7e14-4b06-9463-0fdc79e3d414 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1273 microversion: 2.1 time: 0.100429 Aug 22 11:18:34.946730 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 550/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:34 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:35.968589 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:35.969194 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:35.975653 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:35.981717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:35.981717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:35.981717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:35.981717 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:35.982113 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:36.077743 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-5cfedaea-3f24-41e8-9aa2-1a9138afa5d4 req-713f9d95-c1c2-49bf-b454-0850a21dc03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6fdf2f-7b2d-44ae-add4-b44c18ab102d", "tag": "246664c8-5e8e-4568-a110-1a266ca88576"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:36.088335 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5cfedaea-3f24-41e8-9aa2-1a9138afa5d4 req-713f9d95-c1c2-49bf-b454-0850a21dc03d service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:36.088813 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5cfedaea-3f24-41e8-9aa2-1a9138afa5d4 req-713f9d95-c1c2-49bf-b454-0850a21dc03d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:36.089248 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5cfedaea-3f24-41e8-9aa2-1a9138afa5d4 req-713f9d95-c1c2-49bf-b454-0850a21dc03d service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:36.109421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-5cfedaea-3f24-41e8-9aa2-1a9138afa5d4 req-713f9d95-c1c2-49bf-b454-0850a21dc03d service nova] Creating event network-changed:246664c8-5e8e-4568-a110-1a266ca88576 for instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d on hv-cinder-85394 Aug 22 11:18:36.109421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-5cfedaea-3f24-41e8-9aa2-1a9138afa5d4 req-713f9d95-c1c2-49bf-b454-0850a21dc03d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 Aug 22 11:18:36.109421 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 551/1111] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:18:36.110880 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:36.119208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-67be6d27-d6f7-41c0-826c-6966e9a7082c tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.154426 Aug 22 11:18:36.119208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 561/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:35 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:18:37.141542 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:37.142261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:37.148416 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:37.154061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:37.154061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:37.154061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:37.154061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:37.154486 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:37.545519 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:37.553640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e9b25e22-417d-4f8d-aeac-d2ea7e1b5ae6 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.417035 Aug 22 11:18:37.554261 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 552/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:37 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:38.574382 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:38.574989 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:38.581991 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:38.582561 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:38.582990 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:38.583669 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:38.584116 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:38.584530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:38.708967 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:38.716356 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-e0c86dcd-461c-4ad7-b436-2e7d2cc30a94 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.145830 Aug 22 11:18:38.716910 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 562/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:38 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:39.739657 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:39.740264 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:39.746134 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:39.746645 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:39.747071 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:39.748059 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:39.748505 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:39.748921 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:39.876425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:39.884031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d623fa8d-b11f-4a48-920a-51b499c50e51 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.149301 Aug 22 11:18:39.884586 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 553/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:39 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:40.904949 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:40.905559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:40.912802 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:40.913280 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:40.913714 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:40.914434 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:40.914888 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:40.915342 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:41.050725 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:41.058254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-ef452d36-71ef-4e5b-9527-10d20e032b3e tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.157181 Aug 22 11:18:41.058848 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 563/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:40 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:42.079430 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:42.080039 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:42.081978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:42.086727 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:42.087209 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:42.087643 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:42.088326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:42.088777 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:42.089195 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:42.222619 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:42.230360 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-db84e57c-3e35-4588-81e0-a12d43bd302b tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.154919 Aug 22 11:18:42.230959 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 554/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:42 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:42.463452 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-a21778f8-da4b-4f0b-893f-f98045c58283 req-c2533040-c940-4c27-b20e-5e58e26ec196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6fdf2f-7b2d-44ae-add4-b44c18ab102d", "name": "network-vif-plugged", "status": "completed", "tag": "246664c8-5e8e-4568-a110-1a266ca88576"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:42.463452 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell0:SELECT=2 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:42.467723 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a21778f8-da4b-4f0b-893f-f98045c58283 req-c2533040-c940-4c27-b20e-5e58e26ec196 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:42.468193 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a21778f8-da4b-4f0b-893f-f98045c58283 req-c2533040-c940-4c27-b20e-5e58e26ec196 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:42.468611 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-a21778f8-da4b-4f0b-893f-f98045c58283 req-c2533040-c940-4c27-b20e-5e58e26ec196 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:42.479652 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-a21778f8-da4b-4f0b-893f-f98045c58283 req-c2533040-c940-4c27-b20e-5e58e26ec196 service nova] Creating event network-vif-plugged:246664c8-5e8e-4568-a110-1a266ca88576 for instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d on hv-cinder-85394 Aug 22 11:18:42.485557 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-a21778f8-da4b-4f0b-893f-f98045c58283 req-c2533040-c940-4c27-b20e-5e58e26ec196 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031620 Aug 22 11:18:42.486155 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 564/1118] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:18:43.251877 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:43.252482 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:43.254364 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=8 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:43.259523 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:43.259997 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:43.260427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:43.261170 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:43.261616 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:43.262066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:43.392184 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:43.399672 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a3660d27-0914-4131-ae5c-bdf2be8c6cb0 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1315 microversion: 2.1 time: 0.152624 Aug 22 11:18:43.400220 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 555/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:43 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:44.388189 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:44.388768 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:44.397234 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.397740 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.398242 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.404393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.404393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.404393 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.428907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:18:44.521788 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-4f8eaf37-f480-48d8-a44b-40862c3c96d8 req-f14f1772-7295-4aad-af7c-d7562b6804c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6", "tag": "76fdf4ae-a83b-4685-a786-3056b34a2406"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:44.532768 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4f8eaf37-f480-48d8-a44b-40862c3c96d8 req-f14f1772-7295-4aad-af7c-d7562b6804c6 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.533244 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4f8eaf37-f480-48d8-a44b-40862c3c96d8 req-f14f1772-7295-4aad-af7c-d7562b6804c6 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.533678 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-4f8eaf37-f480-48d8-a44b-40862c3c96d8 req-f14f1772-7295-4aad-af7c-d7562b6804c6 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.546970 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-4f8eaf37-f480-48d8-a44b-40862c3c96d8 req-f14f1772-7295-4aad-af7c-d7562b6804c6 service nova] Creating event network-changed:76fdf4ae-a83b-4685-a786-3056b34a2406 for instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 on hv-cinder-85394 Aug 22 11:18:44.555749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-4f8eaf37-f480-48d8-a44b-40862c3c96d8 req-f14f1772-7295-4aad-af7c-d7562b6804c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167700 Aug 22 11:18:44.555749 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 556/1120] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:18:44.558254 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:44.558954 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:44.565882 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.566405 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.566843 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.567633 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.568087 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.568512 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.809887 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:44.819083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-686eebd6-f505-4fd8-b004-a9b20e148195 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1464 microversion: 2.1 time: 0.264696 Aug 22 11:18:44.819666 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 557/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:44 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:44.839338 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5fea2d48-9e4f-402e-9f16-8e8492c63cd4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 204 len: 0 microversion: 2.1 time: 0.455940 Aug 22 11:18:44.840267 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 565/1122] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:18:44 2022] DELETE /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 11:18:44.848834 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:44.849456 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:44.855873 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.856593 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.857369 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.858911 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.859240 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.859710 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.877100 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:44.877820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:44.886131 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.887031 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.887958 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.889325 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:44.890078 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:44.890720 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:44.920205 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:18:45.004900 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:45.012600 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff1830c7-355d-4102-93af-277e1a0adccb tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1576 microversion: 2.1 time: 0.168051 Aug 22 11:18:45.013152 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 558/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:44 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:45.238222 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-9e0a75c4-0b16-4b7d-93d4-09dc443fddc9 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 204 len: 0 microversion: 2.1 time: 0.367785 Aug 22 11:18:45.238847 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 566/1124] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:18:44 2022] DELETE /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:18:45.247197 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:45.248186 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:45.255417 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:45.256190 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:45.256818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:45.257450 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:45.257794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:45.258222 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:45.403020 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:45.411618 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-28dc6748-5ccb-40e2-8583-86d7ca998253 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1470 microversion: 2.1 time: 0.168208 Aug 22 11:18:45.412206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 559/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:45 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:18:46.035285 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:46.036005 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:46.042469 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:46.042941 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:46.043370 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:46.044046 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:46.044492 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:46.044926 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:46.177872 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:46.185790 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-4dafa8e3-9e61-42ef-8645-25b6558cce00 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1576 microversion: 2.1 time: 0.154766 Aug 22 11:18:46.189475 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 567/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:46 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:46.433223 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:46.433772 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:46.440544 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:46.441031 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:46.441469 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:46.442164 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:46.442650 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:46.443079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:46.580066 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:46.587707 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c14cfc47-6545-4899-80d0-002f770b8642 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1470 microversion: 2.1 time: 0.158438 Aug 22 11:18:46.588272 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 560/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:46 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:47.208756 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:47.209318 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:47.215880 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:47.216368 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:47.216800 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:47.217499 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:47.218121 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:47.218614 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:47.362640 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:47.372243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-6e25f03b-925d-4de7-8f82-e874635d31f7 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1576 microversion: 2.1 time: 0.166064 Aug 22 11:18:47.372243 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 568/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:47 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:18:47.615082 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:47.615867 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:47.623009 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:47.623413 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:47.623846 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:47.624546 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:47.624995 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:47.626116 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:48.011316 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:48.023641 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a6ca580f-256b-495a-a6ec-0a375d728ccf tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1470 microversion: 2.1 time: 0.414307 Aug 22 11:18:48.027938 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 561/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:47 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1470 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 11:18:48.214397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-5cad5ee3-880e-46c2-af1e-44f2441ad79f req-a5104545-53ce-4631-83ae-154fbcee5806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6", "name": "network-vif-deleted", "tag": "76fdf4ae-a83b-4685-a786-3056b34a2406"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:48.225039 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-5cad5ee3-880e-46c2-af1e-44f2441ad79f req-a5104545-53ce-4631-83ae-154fbcee5806 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:48.225729 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-5cad5ee3-880e-46c2-af1e-44f2441ad79f req-a5104545-53ce-4631-83ae-154fbcee5806 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:48.226254 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-5cad5ee3-880e-46c2-af1e-44f2441ad79f req-a5104545-53ce-4631-83ae-154fbcee5806 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:48.238534 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-5cad5ee3-880e-46c2-af1e-44f2441ad79f req-a5104545-53ce-4631-83ae-154fbcee5806 service nova] Creating event network-vif-deleted:76fdf4ae-a83b-4685-a786-3056b34a2406 for instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 on hv-cinder-85394 Aug 22 11:18:48.243936 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-5cad5ee3-880e-46c2-af1e-44f2441ad79f req-a5104545-53ce-4631-83ae-154fbcee5806 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033329 Aug 22 11:18:48.244613 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 569/1130] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:18:48.394578 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:48.395588 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:48.415228 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [req-1ec180ab-5e7b-4f0f-b4ad-084ffe975759 req-66d294db-3ceb-4131-9c6f-215d143fdba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6fdf2f-7b2d-44ae-add4-b44c18ab102d", "name": "network-vif-deleted", "tag": "246664c8-5e8e-4568-a110-1a266ca88576"}]} {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:48.418611 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:48.419337 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:48.419780 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:48.421137 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:48.421598 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:48.422573 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:48.428906 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-1ec180ab-5e7b-4f0f-b4ad-084ffe975759 req-66d294db-3ceb-4131-9c6f-215d143fdba1 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:48.429522 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-1ec180ab-5e7b-4f0f-b4ad-084ffe975759 req-66d294db-3ceb-4131-9c6f-215d143fdba1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:48.430089 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [req-1ec180ab-5e7b-4f0f-b4ad-084ffe975759 req-66d294db-3ceb-4131-9c6f-215d143fdba1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:48.444306 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.compute.server_external_events [req-1ec180ab-5e7b-4f0f-b4ad-084ffe975759 req-66d294db-3ceb-4131-9c6f-215d143fdba1 service nova] Creating event network-vif-deleted:246664c8-5e8e-4568-a110-1a266ca88576 for instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d on hv-cinder-85394 Aug 22 11:18:48.450574 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [req-1ec180ab-5e7b-4f0f-b4ad-084ffe975759 req-66d294db-3ceb-4131-9c6f-215d143fdba1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040268 Aug 22 11:18:48.451317 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 570/1131] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:18:48.510795 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:48.520127 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d43047f8-b9c7-4817-9841-164e45ed2a56 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1224 microversion: 2.1 time: 0.129639 Aug 22 11:18:48.520819 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:48 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:49.048402 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:49.049094 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:49.055226 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:49.055703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:49.056137 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:49.056820 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:49.057273 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:49.057691 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:49.090353 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:49.090831 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:49.091261 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:49.091703 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.objects.instance [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lazy-loading 'fault' on Instance uuid fb6fdf2f-7b2d-44ae-add4-b44c18ab102d {{(pid=121143) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:18:49.134084 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aadc4ee42aa14dff8860e7dc84ff4e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6ff5a309d244f9ac20399bff4dcc27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:49.142208 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-0bf919c4-164d-40fb-81ed-1709dd0385ff tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 200 len: 1305 microversion: 2.1 time: 0.098186 Aug 22 11:18:49.142786 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 571/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:49 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:49.542536 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:49.543156 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:49.551878 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:49.560346 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:49.560346 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:49.560346 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:49.560346 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:49.560797 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:49.587980 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:49.588396 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:49.588843 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:49.589281 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lazy-loading 'fault' on Instance uuid 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:18:49.635794 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:49.644326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a895d99b-ab5d-49cf-bd24-87bf84e60c85 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 200 len: 1229 microversion: 2.1 time: 0.106684 Aug 22 11:18:49.644915 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 563/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:49 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:50.163559 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:50.164149 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] [instance: fb6fdf2f-7b2d-44ae-add4-b44c18ab102d] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:50.170343 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:50.170812 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:50.171236 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:50.172570 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:50.173065 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:50.173480 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:50.186274 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] HTTP exception thrown: Instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d could not be found. Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Request method failure captured: Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d HTTP/1.1 Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2YFRKRvgC3q2315dNQhyalSKsEykQgbCkqE8tpzJpI6iBIM40qTdEPOWYUJwpxjnevKXTllNYkZEIju4I8HyINNVQXYIlf9JEk14DPQ_PrLhBy3gB24YRTUPQ0LfVo1MwokMGZFB72ZBFSBzX860dIZZkPq9sKHWoKL8OlKQsiwRQc Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: ad6ff5a309d244f9ac20399bff4dcc27 Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-VolumesNegativeTest-575512756 Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:18:50.187905 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad6ff5a309d244f9ac20399bff4dcc27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ad6ff5a309d244f9ac20399bff4dcc27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ad6ff5a309d244f9ac20399bff4dcc27", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad6ff5a309d244f9ac20399bff4dcc27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-VolumesNegativeTest-575512756 Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: ad6ff5a309d244f9ac20399bff4dcc27 Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-VolumesNegativeTest-575512756 Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-VolumesNegativeTest-575512756-project Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: aadc4ee42aa14dff8860e7dc84ff4e0b Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-VolumesNegativeTest-575512756-project Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d could not be found. Aug 22 11:18:50.189702 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': 'fb6fdf2f-7b2d-44ae-add4-b44c18ab102d'} Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d could not be found. Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:18:50.190927 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d could not be found. Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d could not be found. Aug 22 11:18:50.192598 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.194068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] Returning 404 to user: Instance fb6fdf2f-7b2d-44ae-add4-b44c18ab102d could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:18:50.194068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5156a3f7-c253-4d29-83da-898c1ce6cae1 tempest-VolumesNegativeTest-575512756 tempest-VolumesNegativeTest-575512756-project] 10.222.0.48 "GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d" status: 404 len: 111 microversion: 2.1 time: 0.029587 Aug 22 11:18:50.194068 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 572/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:50 2022] GET /compute/v2.1/servers/fb6fdf2f-7b2d-44ae-add4-b44c18ab102d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:18:50.666594 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:50.667208 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:50.673563 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:50.674042 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:50.674583 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:50.675206 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:50.675656 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:50.676079 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:50.690978 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] HTTP exception thrown: Instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 could not be found. Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Request method failure captured: Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 HTTP/1.1 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Rkl5N7lIkmP564dTKtuw3SbjMJOhqE6fAIjOusT8eBB4dYVAHUP3_Ds47W9gPHtYB1eBwzeecYa6oE7E3JsIk36Zd3oBGn4CS_1KE-btH4pM9W-bLaY06hfKS-6yyCj3mKr5kHrbvGnU2nyYKPAmVfOjfELeTyUg1RTVHnDCdsL04 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:18:50.692535 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02c34172aa804fe695944f629a348c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02c34172aa804fe695944f629a348c58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 9ca8c5d1971a4ec1a448f2081ceb835b Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 could not be found. Aug 22 11:18:50.694502 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6'} Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 could not be found. Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:18:50.695333 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 could not be found. Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 could not be found. Aug 22 11:18:50.696830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:50.698257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Returning 404 to user: Instance 8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:18:50.698257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1aeeff08-204c-4b99-a828-d76aba92c5f1 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6" status: 404 len: 111 microversion: 2.1 time: 0.031213 Aug 22 11:18:50.698257 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:50 2022] GET /compute/v2.1/servers/8f20aeb3-54a6-433f-b6e4-32cfbbd93eb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:18:54.135315 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-5236aa75-6717-4a73-bedd-444f6f984496 req-2cf14fc6-fdcf-4d60-8f9a-be5f7b3d99c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d654e40-0fcf-46a6-938f-a784f1e7f736", "tag": "4065871f-1795-46ad-ae8f-c7969723a9fa"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:54.139114 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:54.139114 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:54.151387 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5236aa75-6717-4a73-bedd-444f6f984496 req-2cf14fc6-fdcf-4d60-8f9a-be5f7b3d99c1 service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:54.154840 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:54.155323 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:54.155761 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:54.156893 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:54.157024 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:54.157397 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:54.161892 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5236aa75-6717-4a73-bedd-444f6f984496 req-2cf14fc6-fdcf-4d60-8f9a-be5f7b3d99c1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:54.162379 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5236aa75-6717-4a73-bedd-444f6f984496 req-2cf14fc6-fdcf-4d60-8f9a-be5f7b3d99c1 service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:54.174735 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-5236aa75-6717-4a73-bedd-444f6f984496 req-2cf14fc6-fdcf-4d60-8f9a-be5f7b3d99c1 service nova] Creating event network-changed:4065871f-1795-46ad-ae8f-c7969723a9fa for instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 on hv-cinder-85394 Aug 22 11:18:54.180061 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-5236aa75-6717-4a73-bedd-444f6f984496 req-2cf14fc6-fdcf-4d60-8f9a-be5f7b3d99c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048599 Aug 22 11:18:54.180651 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 565/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 11:18:54.187980 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Going to try to terminate instance {{(pid=121143) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 11:18:54.331749 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG dbcounter [-] [121143] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:54.536129 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-04201108-7593-4b79-85cd-472c7b121f71 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 204 len: 0 microversion: 2.1 time: 0.408895 Aug 22 11:18:54.540056 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 573/1138] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:18:54 2022] DELETE /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 11:18:54.547567 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:54.548282 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:54.554818 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:54.555499 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:54.556088 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:54.557029 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:54.557509 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:54.557908 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:54.706844 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:54.714658 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-abf43326-4c67-43bf-915c-eed5c14e2641 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1577 microversion: 2.1 time: 0.171257 Aug 22 11:18:54.715232 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 566/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:54 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:55.739023 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:55.739778 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:55.746103 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:55.746622 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:55.748663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:55.748663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:55.748663 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:55.749055 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:55.885588 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:55.893673 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-bd4ef09a-3ccd-4dfe-a2cb-4e34cf04123a tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1577 microversion: 2.1 time: 0.160548 Aug 22 11:18:55.898543 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 574/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:55 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:56.774858 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-8266851c-3efd-45b3-862e-e384629ce320 req-3e8360ff-19e4-40d4-aea6-1bc0ed7eed7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d654e40-0fcf-46a6-938f-a784f1e7f736", "name": "network-vif-deleted", "tag": "4065871f-1795-46ad-ae8f-c7969723a9fa"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 11:18:56.785807 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-8266851c-3efd-45b3-862e-e384629ce320 req-3e8360ff-19e4-40d4-aea6-1bc0ed7eed7f service nova] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:56.786096 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-8266851c-3efd-45b3-862e-e384629ce320 req-3e8360ff-19e4-40d4-aea6-1bc0ed7eed7f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:56.786280 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-8266851c-3efd-45b3-862e-e384629ce320 req-3e8360ff-19e4-40d4-aea6-1bc0ed7eed7f service nova] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:56.797838 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-8266851c-3efd-45b3-862e-e384629ce320 req-3e8360ff-19e4-40d4-aea6-1bc0ed7eed7f service nova] Creating event network-vif-deleted:4065871f-1795-46ad-ae8f-c7969723a9fa for instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 on hv-cinder-85394 Aug 22 11:18:56.802745 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-8266851c-3efd-45b3-862e-e384629ce320 req-3e8360ff-19e4-40d4-aea6-1bc0ed7eed7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031631 Aug 22 11:18:56.803326 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 567/1141] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 22 11:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 11:18:56.914903 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:56.915500 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:56.923138 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:56.923675 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:56.924120 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:56.924816 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:56.925273 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:56.925699 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:56.989251 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.policy [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121143) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:56.997269 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-faddfba8-76de-46ed-8b90-18e11a6c6dea tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1226 microversion: 2.1 time: 0.086272 Aug 22 11:18:56.998171 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 575/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:56 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:58.020154 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:58.020766 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:58.027121 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:58.027627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:58.028034 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:58.028719 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:58.029165 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:58.029584 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:58.062327 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:58.063682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:58.063682 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:58.063896 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lazy-loading 'fault' on Instance uuid 8d654e40-0fcf-46a6-938f-a784f1e7f736 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 11:18:58.109202 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca8c5d1971a4ec1a448f2081ceb835b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c34172aa804fe695944f629a348c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 11:18:58.112636 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:18:58.116493 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-991ac761-b6ac-4153-93f0-bb584c77a4f4 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 200 len: 1185 microversion: 2.1 time: 0.101855 Aug 22 11:18:58.117083 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 568/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:58 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 1185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 11:18:59.137597 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:59.138150 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 8d654e40-0fcf-46a6-938f-a784f1e7f736] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:59.144653 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:59.145134 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:59.145573 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:59.146283 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:59.146742 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:59.147170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:59.160630 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] HTTP exception thrown: Instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 could not be found. Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Request method failure captured: Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 HTTP/1.1 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2Rkl5N7lIkmP564dTKtuw3SbjMJOhqE6fAIjOusT8eBB4dYVAHUP3_Ds47W9gPHtYB1eBwzeecYa6oE7E3JsIk36Zd3oBGn4CS_1KE-btH4pM9W-bLaY06hfKS-6yyCj3mKr5kHrbvGnU2nyYKPAmVfOjfELeTyUg1RTVHnDCdsL04 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:18:59.162272 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02c34172aa804fe695944f629a348c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02c34172aa804fe695944f629a348c58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 9ca8c5d1971a4ec1a448f2081ceb835b Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 could not be found. Aug 22 11:18:59.163789 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '8d654e40-0fcf-46a6-938f-a784f1e7f736'} Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 could not be found. Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:18:59.164751 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 could not be found. Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 could not be found. Aug 22 11:18:59.166374 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.167907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Returning 404 to user: Instance 8d654e40-0fcf-46a6-938f-a784f1e7f736 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:18:59.167907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-fed78b43-5fef-4697-aa3c-3ecf08e7c735 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736" status: 404 len: 111 microversion: 2.1 time: 0.029973 Aug 22 11:18:59.167907 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 576/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:59 2022] GET /compute/v2.1/servers/8d654e40-0fcf-46a6-938f-a784f1e7f736 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:18:59.651627 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:59.652173 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:59.659922 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:59.660401 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:59.660830 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:59.661521 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:59.661968 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:59.662427 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:59.675640 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] HTTP exception thrown: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Request method failure captured: Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 HTTP/1.1 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Connection: close Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Host: 10.222.0.48 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjA2Rkl5N7lIkmP564dTKtuw3SbjMJOhqE6fAIjOusT8eBB4dYVAHUP3_Ds47W9gPHtYB1eBwzeecYa6oE7E3JsIk36Zd3oBGn4CS_1KE-btH4pM9W-bLaY06hfKS-6yyCj3mKr5kHrbvGnU2nyYKPAmVfOjfELeTyUg1RTVHnDCdsL04 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 22 11:18:59.677273 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02c34172aa804fe695944f629a348c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02c34172aa804fe695944f629a348c58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Id: 9ca8c5d1971a4ec1a448f2081ceb835b Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: method: > Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: exception: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.678862 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: action_args: {'id': '89384f88-a64f-4bb4-aac9-daba0fd449c6'} Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:18:59.679703 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.681334 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.683038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Returning 404 to user: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:18:59.683038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fc02926f-5a0c-43dc-9989-677221c2d9a3 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 404 len: 111 microversion: 2.1 time: 0.031081 Aug 22 11:18:59.683038 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 569/1145] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 22 11:18:59 2022] DELETE /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 11:18:59.687456 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '>' {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:18:59.688072 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.compute.api [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [instance: 89384f88-a64f-4bb4-aac9-daba0fd449c6] Fetching instance by UUID {{(pid=121143) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 11:18:59.693969 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:59.694427 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:59.694885 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:59.695558 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Acquiring lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 11:18:59.696003 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 11:18:59.696418 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG oslo_concurrency.lockutils [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Lock "4636e7ec-f34c-4137-85d0-63ba3e40bf57" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 11:18:59.710012 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.wsgi [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] HTTP exception thrown: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Request method failure captured: Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: request: GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 HTTP/1.1 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept: application/json Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Accept-Encoding: identity Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Connection: close Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Length: 0 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Content-Type: application/json Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Host: 10.222.0.48 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Openstack-System-Scope: None Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: User-Agent: python-urllib3/1.26.11 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Auth-Token: gAAAAABjA2Rkl5N7lIkmP564dTKtuw3SbjMJOhqE6fAIjOusT8eBB4dYVAHUP3_Ds47W9gPHtYB1eBwzeecYa6oE7E3JsIk36Zd3oBGn4CS_1KE-btH4pM9W-bLaY06hfKS-6yyCj3mKr5kHrbvGnU2nyYKPAmVfOjfELeTyUg1RTVHnDCdsL04 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Id: None Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Domain-Name: None Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Identity-Status: Confirmed Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Is-Admin-Project: True Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Id: default Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Domain-Name: Default Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Project-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Role: member,reader Aug 22 11:18:59.711530 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Roles: member,reader Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02c34172aa804fe695944f629a348c58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02c34172aa804fe695944f629a348c58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02c34172aa804fe695944f629a348c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Id: 02c34172aa804fe695944f629a348c58 Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-Tenant-Name: tempest-TestVolumeBootPattern-534572824 Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Id: default Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Domain-Name: Default Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Id: 9ca8c5d1971a4ec1a448f2081ceb835b Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: X-User-Name: tempest-TestVolumeBootPattern-534572824-project Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: method: > Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: exception: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.713431 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: action_args: {'id': '89384f88-a64f-4bb4-aac9-daba0fd449c6'} Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: {{(pid=121143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 11:18:59.718049 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. Aug 22 11:18:59.720460 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: ERROR nova.api.openstack.wsgi Aug 22 11:18:59.722432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: DEBUG nova.api.openstack.wsgi [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Returning 404 to user: Instance 89384f88-a64f-4bb4-aac9-daba0fd449c6 could not be found. {{(pid=121143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 11:18:59.722432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO nova.api.openstack.requestlog [None req-5f896c6b-707c-4203-abf2-52617ed9515b tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6" status: 404 len: 111 microversion: 2.1 time: 0.029535 Aug 22 11:18:59.722432 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: [pid: 121143|app: 0|req: 577/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 22 11:18:59 2022] GET /compute/v2.1/servers/89384f88-a64f-4bb4-aac9-daba0fd449c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 11:19:01.369266 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-026cd540-0fc1-4ffe-873b-997d37481768 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] Calling method '.version_select at 0x7f3b4cab8dc0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 11:19:01.374070 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [None req-026cd540-0fc1-4ffe-873b-997d37481768 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [c559dcd1-e8f2-45b2-958f-1dbd50871f45] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 11:19:02.381447 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [None req-026cd540-0fc1-4ffe-873b-997d37481768 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] [c559dcd1-e8f2-45b2-958f-1dbd50871f45] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 59238. Aug 22 11:19:02.388212 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 11:19:02.452425 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-026cd540-0fc1-4ffe-873b-997d37481768 tempest-TestVolumeBootPattern-534572824 tempest-TestVolumeBootPattern-534572824-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1340322727" status: 202 len: 0 microversion: 2.1 time: 1.087036 Aug 22 11:19:02.453369 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 570/1147] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Aug 22 11:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1340322727 => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 11:19:28.814745 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 22 11:19:28.815302 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Mon Aug 22 11:19:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:21:09.466333 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:21:09.466930 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Mon Aug 22 11:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:21:11.162035 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:21:11.162615 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Mon Aug 22 11:21:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:22:48.823170 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:22:48.823799 dv-cinder-853941-1-iscsi devstack@n-api.service[121143]: Mon Aug 22 11:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 11:24:27.304145 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 11:24:27.304790 dv-cinder-853941-1-iscsi devstack@n-api.service[121142]: Mon Aug 22 11:24:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!